TECHNICAL  MEMORANDUM  NO.  CIT-CDS  95-002 

January  1995 


“Attenuation  of  Persistant  /^-Bounded  Disturbances 
for  Nonlinear  Systems” 

Wei-Min  Lu  and  John  Doyle 


Control  and  Dynamical  Systems 

California  Institute  of  Technology 
Pasadena,  CA  91125 


Report  Documentation  Page 

Form  Approved 

OMB  No.  0704-0188 

Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 

VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
does  not  display  a  currently  valid  OMB  control  number. 

1.  REPORT  DATE 

JAN  1995 

2.  REPORT  TYPE 

3.  DATES  COVERED 

00-00-1995  to  00-00-1995 

4.  TITLE  AND  SUBTITLE 

5a.  CONTRACT  NUMBER 

Attenuation  of  Persistant  L-Bounded  Disturbances  for  Nonlinear 

5b.  GRANT  NUMBER 

If  11  IN 

5c.  PROGRAM  ELEMENT  NUMBER 

6.  AUTHOR(S) 

5d.  PROJECT  NUMBER 

5e.  TASK  NUMBER 

5f.  WORK  UNIT  NUMBER 

7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

California  Institute  of  Technology, Control  and  Dynamical 

Systems, Pasadena, C  A, 91 125 

8.  PERFORMING  ORGANIZATION 

REPORT  NUMBER 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 

10.  SPONSOR/MONITOR'S  ACRONYM(S) 

11.  SPONSOR/MONITOR'S  REPORT 
NUMBER(S) 

12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Approved  for  public  release;  distribution  unlimited 

13.  SUPPLEMENTARY  NOTES 

14.  ABSTRACT 

15.  SUBJECT  TERMS 

16.  SECURITY  CLASSIFICATION  OF: 

17.  LIMITATION  OF 
ABSTRACT 

18.  NUMBER 

OF  PAGES 

32 

19a.  NAME  OF 
RESPONSIBLE  PERSON 

a.  REPORT 

unclassified 

b.  ABSTRACT 

unclassified 

c.  THIS  PAGE 

unclassified 

Standard  Form  298  (Rev.  8-98) 

Prescribed  by  ANSI  Std  Z39-18 


Attenuation  of  Persistent  /^-Bounded  Disturbances 

for  Nonlinear  Systems 

Wei-Min  Lu*  and  John  C.  Doyle+ 


Abstract 

A  version  of  nonlinear  generalization  of  the  £1-control  problem,  which  deals  with  the  at¬ 
tenuation  of  persistent  bounded  disturbances  in  £co-sense,  is  investigated  in  this  paper.  The 
methods  used  in  this  paper  are  motivated  by  [23].  The  main  idea  in  the  ^-performance  analysis 
and  synthesis  is  to  construct  a  certain  invariant  subset  of  the  state-space  such  that  achieving 
disturbance  rejection  is  equivalent  to  restricting  the  state-dynamics  to  this  set.  The  concepts 
from  viability  theory,  nonsmooth  analysis,  and  set-valued  analysis  play  important  roles.  In  ad¬ 
dition,  the  relation  between  the  £  ■'■-control  of  a  continuous-time  system  and  the  ^-control  of  its 
Euler  approximated  discrete-time  systems  is  established. 

Key  Words:  Controlled  Invariance,  Disturbance  Rejection,  /^-Optimal  Control,  Nonlinear 
Systems,  Robust  Control. 


1  Introduction 

The  problem  of  optimal  rejection  of  persistent  bounded  disturbance  for  a  linear  system 
was  posed  by  Vidyasagar  in  [26].  It  is  a  minimax  optimization  problem,  i.e.,  the  problem  of 
minimization  of  the  worst  possible  impact  of  a  class  of  persistent  bounded  disturbances  on  the 
system.  If  the  disturbance  is  denoted  by  w  and  the  signal  measuring  the  impact  by  z,  and  both 
signals  are  measured  in  £TO  (in  continuous  time  case),  then  the  performance  to  be  minimized  is 

J  :=  sup  IML  (1) 

u'e£oo[0i°°)ilMloo^1 

This  problem  is  known  as  zT-optimal  control  problem  [11,  12,  10],  because  the  minimization  (1) 
amounts  to  the  minimization  of  the  Too-induced  norm,  i.e.,  the  ZT-norm,  of  the  linear  system.  The 
linear  ZN(or  tl  in  discrete- time  case)-optimal  control  problem  was  extensively  investigated  in  an 
input/output  setting  by  using  Youla-parameterization  [11,  12,  10].  The  relation  between  the  T1- 
control  of  a  linear  continuous-time  system  and  the  ^-control  of  its  Euler  approximated  discrete- time 
systems  was  established  in  [6].  Recently,  for  a  linear  discrete-time  system,  the  corresponding  l1- 
optimal  control  problem  was  solved  in  a  state  space  setting  in  terms  of  dynamical  state- feedback  [14, 
10],  continuous  nonlinear  static  state-feedback  [22,  23],  and  piece- wise  linear  static  state-feedback 
[7].  Furthermore,  Shamma  [23]  showed  that  if  the  linear  ^-optimal  control  has  any  kind  of  solution, 
then  there  must  exist  a  continuous  (nonlinear)  static  state-feedback  ^-controller.  It  is  possible 
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that  by  allowing  the  class  of  continuous  nonlinear  controllers,  one  can  make  the  closed-loop  £1- 
performance  (1)  strictly  smaller  than  one  can  do  using  only  linear  controllers  [13,  24].  Therefore, 
it  is  natural  to  consider  such  an  optimal  disturbance  rejection  problem  in  the  nonlinear  domain. 

In  this  paper,  we  will  consider  the  problem  of  optimal  rejection  of  T^-bounded  disturbance  for 
continuous-time  nonlinear  systems.  However,  in  the  nonlinear  setting,  the  minimax  optimization 
problem  (1)  is  not  equivalent  to  the  minimization  of  the  Too-induced  gains  of  the  corresponding 
nonlinear  operators,  while  we  will  borrow  the  terminology  nonlinear  /^-control  to  refer  to  the 
corresponding  nonlinear  minimax  optimization  problem  for  convenience.  The  methods  used  in 
this  paper  are  greatly  motivated  by  Shamma  [22,  23],  in  which  the  /x- control  problem  for  a  linear 
discrete-time  system  is  constructively  solved  in  terms  of  continuous  nonlinear  static  state-feedback. 
The  main  idea  in  the  T1  (^^-performance  analysis  and  synthesis  is  to  construct  a  certain  invariant 
subset  of  the  state-space  such  that  achieving  disturbance  rejection  is  equivalent  to  restricting  the 
state  dynamics  to  this  set.  The  techniques  from  viability  theory,  nonsmooth  analysis,  and  set-valued 
analysis  [3,  4,  9,  1]  are  extensively  used;  and  the  notion  of  (controlled)  invariance  [28,  1,  23] 
plays  a  central  role.  This  treatment  provides  some  geometrical  insights  into  the  robust  (T1)  control 
problem.  It  is  remarked  that  the  invariance  notion  has  also  been  employed  in  other  nonlinear 
contexts,  such  as  the  control  synthesis  with  state  and  control  constraints  (see  [16,  19,  5,  15]  and 
references  therein)  and  the  zero  dynamics  [18,  2,  21], 

The  remainder  of  this  paper  is  organized  as  follows.  Some  mathematical  preliminaries  are 
provided  in  Appendix  A,  in  which  some  concepts  from  set-valued  analysis  and  nonsmooth  anal¬ 
ysis  are  reviewed,  and  the  emphasis  is  on  set-valued  maps  and  contingent  cones.  In  section  2, 
the  T’-performance  for  a  nonlinear  system  is  analyzed.  The  ^-performance  of  a  nonlinear  sys¬ 
tem  is  characterized  in  terms  of  £1-performance  domains.  In  section  3,  the  nonlinear  T’-control 
synthesis  problem  is  considered.  The  T’-control  problem  is  characterized  in  terms  of  controlled  T1- 
performance  domains;  a  continuous  static  state-feedback  T’-controller  is  constructed.  In  section  4, 
the  (controlled)  T’-performance  domains  are  characterized  in  terms  of  the  (controlled)  invariance 
domains  of  some  (controlled)  differential  inclusions.  Some  algorithms  for  computing  the  (controlled) 
invariance  domains  are  provided.  In  section  5,  the  computation  issues  are  considered,  and  some 
approximation  methods  are  suggested.  In  particular,  the  relation  between  the  T1-performance  anal¬ 
ysis  and  synthesis  of  a  continuous-time  system  and  and  the  /’--performance  analysis  and  synthesis 
of  its  Euler  approximated  discrete-time  systems  is  established.  Those  proofs  which  are  relatively 
technical  and  less  related  are  put  in  Appendix  B. 

Conventions 

The  following  conventions  are  made  in  this  paper.  Z+  is  the  set  of  non-negative  integers.  R+  := 
[0,  go)  C  R.  Rn  is  n-dimensional  real  Euclidean  space.  For  x  E  Rn,  ||a;||  :=  max{|a:;|  :  i  = 
1,2,  •  •  -  ,n}.  11^11^  :=  ess-sup{||n(t)||  :  t  E  R+}  for  vector-valued  measurable  function  u  :  R+^RP. 
£^[0,00)  is  the  space  of  vector- valued  functions  which  are  measurable  and  essentially  bounded. 
The  prefix  B  for  a  normed  space  denotes  the  closed  unit  ball  in  this  space,  e.g.,  BRn  :=  { v  E 
Rn|  ||u||  <  1}  and  H£oo[0,  oo)  :=  { w  E  £oo[0,  oo)|  IMI^  <  1}. 

2  /^-Performance  Analysis  of  Nonlinear  Systems 

In  this  section,  we  will  give  some  characterizations  of  the  £’ -performance  for  a  nonlinear  system. 
In  the  next  section  the  synthesis  problem  is  considered  based  on  the  analysis  results  in  this  section. 
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Consider  a  system  with  external  disturbances  as  follows, 


(  X  =  f(x,w)  /2n 

I  z  =  h(x,  w) 

where  x  £  Rn  is  the  state  vector,  w  £  BRP  :=  {u  £  R?j  ||v||  <  1}  and  z  £  R5  are  the  external 
disturbance  input  and  the  regulated  output,  respectively.  Suppose  that  if  w{t )  =  0  and  ai(0)  =  0, 
then  x(t)  =  0  and  z(t)  —  0.  The  performance  which  measures  the  property  of  disturbance  rejection 
in  £oo  for  system  (2)  was  formulated  by  Vidyasagar  in  [26]  as  follows, 

J  =  sup  ML  (3) 

it;  GB£oo[0,co) 

Note  that,  in  the  linear  case,  this  performance  J  is  UGIL  i.e.,  the  /l^-induced  norm  of  the 
input/output  map  G  :  w  z.  We  say  that  the  system  has  a  disturbance  attenuation  property 
if  J  <  1.  This  motivates  the  following  definition. 

Definition  2.1  Consider  the  given  system  (2)  with  a;(0)  =  0.  It  has  /T-performance  if  for  all 
w(t )  £  ££co[0,oo),  IK^IL  <  oo  and  ||^(i)|]00  <  1. 

Therefore,  system  (2)  has  /^-performance,  if  and  only  if  it  is  bounded-input-bounded-state 
(BIBS)  stable  and  J  <  1.  The  above  definition  is  a  natural  generalization  of  the  £} -performance 
for  a  linear  system.  In  the  next  few  subsections,  we  will  characterize  the  /^-performances. 

2.1  /^-Performances  and  Reachable  Sets 

Consider  system  (2).  We  will  assume  /  and  h  are  continuous,  and  /( 0, 0)  =  0,  h( 0, 0)  =  0.  Therefore, 
0  £  Rn  is  an  equilibrium  of  the  system  with  w  —  0.  Moreover,  we  assume  the  admissible  disturbance 
set  is 


W  {w  \  [0,oo)->BRp|  w  is  measurable}  =  S/loofOjOo)  (4) 

We  also  define  a  subset  >VC  C  >V  as  follows, 

Wc  :=  {w  £  >V|  w  is  continuous}  (5) 

It  is  assumed  that  system  (2)  has  the  BIBS  property.  Therefore,  all  possible  solutions  with  the 
admissible  inputs  are  in  the  space  C(R+,Mfi).  We  assume  that  system  (2)  is  complete  in  the  sense 
that  for  each  w(t)  £  >V  and  x0  £  E",  the  solution  x(t)  to  (2)  starting  at  #(0)  =  x0  is  uniquely 
defined  for  almost  every  t  £  [0,  oo),  and  the  solution  continuously  depends  on  the  initial  conditions 
with  respect  to  the  compact  convergence  topology  in  C(R+,Rn).  The  state  transition  function 
c I )  :  R+  x  R"  X  IV  — *  R”  is  so  defined  that  x(T)  —  cj)(T,x0,w*)  means  that  system  (2)  evolves  from 
initial  state  x0  to  state  x  in  time  T  under  the  input  action  w* .  Note  that  4>  is  well-defined  and 
is  continuous  with  respect  to  initial  state  because  of  completeness  of  system  (2).  We  define  the 
reachable  state  maps  of  system  (2)  with  the  admissible  input  set  W  and  Wc  in  (4)  as  set-valued 
maps  TZ  :  R”  R"  and  7lc  :  R"  R”  with 

1Z(x)  :=  {<f)(t,x,w)\yw  £  W,t  £  R+}  (6) 

TZc{x)  :=  {4>{t,  x,  w)\Vw  £  Wc,  t  £  R+}  (7) 

Both  IZ(x)  and  TZc(x)  are  bounded  sets  since  system  (2)  is  BIBS. 
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Definition  2.2  A  set  K  £  Rn  is  a  weak  invariant  set  for  system  (2)  with  respect  to  an  admissible 
input  set  IV  if  for  all  x  £  K,  and  w  £  IV,  4>(t,  x,  w )  £  K  for  almost  all  t  >  0. 

The  sets  72(0)  and  72c(0)  have  the  weak  invariance  property.  The  case  for  72(0)  is  stated  as  in  the 
following  proposition. 

Proposition  2.3  For  all  x  £  72.(0),  and  w  £  IV,  cf>(t,x,w)  £  72(0)  for  all  t  >  0.  The  closure  72(0) 
of  72(0)  has  this  weak  invariance  property. 


Proof  If  a;  £  72(0),  then  by  the  definition  of  map  72(0),  there  exist  Wi  £  IV  and  T  £  R+  such 
that  x  =  4>{T,  0,  Wi).  Now  take  w2  £  IV,  define  w  :  E+-^BR?  as 


w(t)  = 


Wi(t )  iff£[0,T] 
w2(t)  if  t  >  T 


and  w  £  IV.  Therefore, 


4>{t,  0,  w)  £  72(0),  Vf  £  R+. 


In  particular,  if  t  >  T, 

<f>(t  -  T,  x ,  w2)  =  <f>(t  -  T,  4>(T,  0,  u>i),  w2)  =  0,  w )  £  72(0) 


To  show  72(0)  is  invariant,  we  need  to  show  that  given  x  £  72(0)  and  w  £  IV,  <f(t,  x ,  w )  £  72(0) 
for  all  t  £  R+.  In  fact,  suppose  there  exists  a  sequence  {xn}  C  72(0),  such  that  xn-^x  as  ^^^oo. 
Therefore,  <f)(t,xn,w )  £  72(0)  C  72(0)  for  all  t  £  R+.  72(0)  is  bounded  since  72(0)  is  bounded, 
therefore,  by  the  completeness  assumption,  <p(t,x,w )  =  lim,,.^  4>(t,  xn,  w)  £  72(0)  for  all  t  £  R+. 
□ 


Next,  we  will  characterize  the  C1  -performance  for  system  (2)  in  terms  of  the  reachable  set.  We 
first  give  a  weaker  definition  as  follow's, 


Definition  2.4  Consider  the  given  system  (2)  with  a;(0)  =  0.  It  has  weak  /T-performance  if 
for  all  w(t)  £  Wc,  ||a:(t)||oo  <  oo  and  IKOIL  <  1. 

Therefore,  if  system  (2)  has  weak  C1  -performance,  then 

Jw  =  sup  ll^ll^  <  1.  (8) 

ul£Wc 

As  system  (2)  is  BIBS,  then  there  exists  a  compact  set  X  C  Kn,  such  that  <j>(t,  0,  w)  £  X  for  all 
w(t)  £  IV.  Define  a  closed  set  as  follows, 

O  :=  {x  £  X|  ||/i(z,u;)||  <  l,Vu?  6  BRP}  (9) 

Then  0  is  bounded.  We  immediately  have  the  following  assertion. 


Theorem  2.5  The  system  (2)  has  Ll -performance  J  <  1  if  and  only  if  72(0)  C  P.  It  has  weak 
Cl -performance  Jw  <  1  if  and  only  «/72c(0)  C  D. 

Furthermore,  the  optimal  performance  J  is  given  by 

J  =  sup{||/i(x,  w)||  \x  £  '72(0),  w  £  BRP}. 


It  is  noted  that  in  general  the  reachable  set  72(0)  and  72c(0)  are  not  easily  computable  by  the 
definitions.  In  the  next  subsection,  we  will  give  some  alternative  characterizations  in  terms  of  the 
notion  of  invariance  for  differential  inclusions. 
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2.2  ^-Performance  Domains 

The  nonlinear  systems  with  C1  -performances  can  be  described  with  the  aid  of  a  differential  inclu¬ 
sions.  Indeed,  let’s  consider  system  (2),  define  a  set-valued  map  F  :  Rn  R"  as 


F(x)  :=  {f(x,w)\w£  BRP} 


(10) 


with  the  domain  Dom(F)  =  f l.  It  is  noted  that  all  solutions  to  the  differential  equation  x  =  f(x,  w) 
with  w(t)  £  W  are  the  solutions  of  the  differential  inclusion 


x  £  F{x) 


(11) 


However,  in  general,  not  all  solutions  of  differential  inclusion  x  £  F(x)  are  the  admissible  solutions 
for  the  system  (2)  for  some  w  £  W;  therefore,  these  two  descriptions  are  not  equivalent.  We  first 
have  the  following  definition.  The  contingent  cone  of  a  set  is  defined  in  Section  7.2. 

Definition  2.6  Consider  system  (2);  the  bounded  set  fl  is  defined  as  in  (9).  A  closed  set  K  G  11 
is  an  ^-performance  domain  for  system  (2)  if  0  G  K  and  for  all  x  £  K  and  w  £  BRP, 


f(x,w)  £  Tk(x). 

where  TK(x)  is  the  contingent  cone  of  set  K  at  x. 


(12) 


It  will  be  seen  that  an  ^-performance  domain  is  a  nonempty  invariance  domain  of  its  corresponding 
differential  inclusion  (10)-(11)  (see  Section  4.1). 

We  first  have  the  following  theorem  about  the  weak  £x -performance. 

Theorem  2.7  Consider  system  (2).  It  has  the  weak  C1  -performance  if  and  only  if  there  exists  an 
C1 -performance  domain  for  system  (2). 

The  proof  of  this  theorem  is  given  in  the  next  subsection.  As  for  the  ^-performance,  we  first 
have  the  following  assertion  for  a  class  of  nonlinear  systems. 

Theorem  2.8  Consider  system  (2). 

(i)  It  has  C1  -performance,  then  there  exists  an  £}  -performance  domain. 

(ii)  If  f(x,  w )  is  locally  Lipschitz  in  x  £  Rn,  then  system  (2)  has  the  C1  -performance  if  and  only 
if  there  exists  an  C1  -performance  domain. 

The  proof  of  this  theorem  is  given  in  the  next  subsection.  In  the  following,  we  will  mainly 
consider  the  case  of  interest  in  the  sequel,  where  system  (2)  is  affine  in  w.  As  a  result,  the  Lipschitz 
property  in  Theorem  2.8  (ii)  is  not  required.  More  concretely,  we  consider  the  following  system, 


&  =  f(x)  +  g(x)w 
z  =  h(x,  w ) 


(13) 


i.e.,  the  function  f(x,w)  in  (2)  is  replaced  by  f(x)  +  g(x)w,  the  other  assumptions  on  f(x,w )  are 
also  imposed  on  /(*)  +  g(x)w. 
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Theorem  2.9  Consider  system  (13)  which  is  affine  in  w.  The  following  statements  are  equivalent. 

(i)  There  exists  an  C1  -performance  domain  for  system  (13). 

(ii)  System  (13)  has  weak  Cl  -performance. 

(Hi)  System  (13)  has  C1 -performance. 

The  proof  will  be  given  in  the  next  subsection.  Theorems  2.5  and  2.9  imply  that  if  7^(0)  C  fl, 
then  it  is  an  /^-performance  domain  for  system  (13).  In  fact,  it  is  the  smallest  Cl -performance 
domain  (Section  4.1).  We  next  give  an  algorithm  to  compute  the  optimal  performance  J  in  (3)  by 
using  the  bisection  method  (which  is  used  in  computing  7/^ -performance  [8]). 

Given  e  >  0,  one  needs  to  find  a  7*  >  0  such  that  7*  -  e  <  J  <  7*  +  e.  Let  7  >  0,  define 

£>7  :=  {x  G  Rn|  \\h(x,  u>)||  <  7 ,Vu>  G  BRP}  (14) 

and  let  Dinv(D7)  be  the  largest  invariance  domain  of  the  differential  inclusion  (10)-(11)  in  D1  (see 
Section  4.1). 

Algorithm  2.10  Give  7 M  >  7m  >  0  such  that  7m  <  J  <  7 M. 

Step  1:  //7m  —  7 m  <  2e,  let  7*  =  (7 M  +7m)/2,  then  stop;  otherwise  go  to  step  2. 

Step  2:  Let  7  =  (7M  +  7m)/2  and  compute  K1  :=  Dinv(D7). 

Step  3:  If  0  G  it7,  then  redefine  '■=  T>  otherwise  let  ~jm  :=  7.  Go  to  step  1. 

The  above  algorithm  can  be  used  to  get  an  approximation  of  optimal  C1  -performance  for  system 
(13). 

2.3  Proofs  of  the  Main  Theorems 

Next,  we  will  prove  Theorems  2.7,  2.8,  and  2.9.  The  techniques  used  in  the  proofs  are  basically 
from  [1,  25,  29]. 

PROOF  OF  THEOREM  2.7 

The  following  lemma  from  [3,  29]  will  be  used  in  the  following  discussion. 

Lemma  2.11  Consider  a  differential  equation  x  =  if(x,t)  with  if  :  Rn  X  R+-^R"  being  continuous. 
Suppose  a  set  K  C  Kn  is  closed.  If  ifixC)  G  TK(x)  for  all  x  G  K  and  t  G  then  for  any 
x0  G  K,  there  exists  a  solution  x(t)  to  the  differential  equation  starting  at  x0  which  is  viable  in  K , 
i.e.  x(t)  G  K  for  almost  all  t  £  [0,  00). 
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Proof  [Theorem  2.7] 

[Necessity]  Let  K  :=  7£c(0)  C  ft,  we  now  show  it  is  an  C1  -performance  domain.  We  need  to 
show  that  for  all  w0  G  BRP  and  x0  E  K ,  f(x0,w0)  E  TK(x).  In  fact,  given  T  >  0,  one  has 
x(t)  —  (f)(t,x0,w(t))  E  K  for  all  t  E  [0,T]  where  w(t)  E  LVC  with  in(0)  =  w0  because  of  the  weak 
invariance  of  the  set  7£c(0).  Therefore, 

x(t)  =  x o+  [  x(s)ds  =  x0  +  t(j  f  f(x(s),w(s))ds) 

Jo  t  Jo 

Notice  that  f(x(s),w(s ))  is  bounded  in  [0,T],  then  by  Lebesgue’s  differentiation  theorem,  one  has 
lim-  /  f(x(s),w(s))ds  =  f(x0,w0) 

t  Jo 

Therefore,  one  can  find  two  sequences  {tn}  and  { vn }  with  fn— » 0+  and  vn^f(x 0,  Wo)  as  n-+ oo,  such 
that  x0  +  tnvn  E  K  for  all  n  E  Z+.  Hence,  f(x0,w 0)  E  TK(x0),  the  conclusion  then  follows  by 
Lemma  7.5. 

[Sufficiency]  Suppose  K  C  ft  is  an  £1-performance  domain.  Given  w(t)  E  >VC,  consider  the 
time- varying  differential  equation 

x  =  f(x,w(t ))  =:  fw(x,t) 

Note  that  the  function  fw  :  Rn  X  R+— >Mn  is  continuous;  and  by  assumption,  fw(x,t)  E  TK(x)  for  all 
x  E  K  and  t  E  R+,  then  by  Lemma  2.11,  for  all  x  E  K,  <f>(t ,  x,  w )  E  K  for  all  t  >  0.  In  particular, 

ne(  o)  c  k  eft.  □ 

PROOF  OF  THEOREM  2.8 

Theorem  2.8  basically  follows  from  [29].  We  first  restate  a  result  from  [29]  which  is  used  in  the 
proof.  The  weak  invariance  is  defined  in  Definition  2.3. 

Lemma  2.12  ([29,  Theorem  3.9])  Consider  system  (2) 

( i )  If  K  is  a  closed  weak  invariant  set  with  respect  to  W,  then  f(x,w)  E  Tk(x)  for  all  x  E  K 
and  w  £  BRP. 

(ii)  If  function  f(x,w )  is  locally  Lipschitz  in  x,  K  is  a  closed  set,  and  f(x,w )  E  TK(x)  for  all 
x  E  K  and  w  E  BRP,  then  both  K  and  its  interior  are  weak  invariant  sets. 

Proof  [Theorem  2.8]  (i)  Suppose  system  (2)  has  £1-performance  J  <  1,  by  Theorem  2.5,  one 
has  that  the  closure  K  :=  1Z( 0)  of  7£(0)  belongs  to  ft,  since  ft  is  closed.  By  Proposition  2.3  and 
Lemma  2.12  (i),  one  has  that  for  all  x  E  K, 

f(x,w)eTK(x),  Vw  E  BRP. 

or  F( x)  C  Tk(x).  Thus,  K  is  an  invariance  domain  for  F,  which  is  closed,  and  0  E  K.  Therefore 
0  E  K  C  DiNv(ft). 

(ii)  The  necessity  is  proved  in  (i),  only  the  sufficiency  is  proved  here.  Suppose  K  :=  DlNv(ft)  3 
0,  then  F(x)  C  TK(x),  or 

f(x,w)6TK(x),  \/w  E  BRP. 
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Then  by  Lemma  2.12  (ii),  one  has  that  for  all  x  G  K ,  and  w  G  >V,  <j>(t,x,w*)  G  iL  for  all  t  >  0;  in 
particular,  7*1(0)  C  K  C  f l.  Then  the  assertion  follows  from  Theorem  2.5.  □ 


PROOF  OF  THEOREM  2.9 

The  following  lemma  is  needed  in  the  proof  of  Theorem  2.9. 

Lemma  2.13  Let  continuous  functions  f(x )  and  g(x )  be  defined  in  (13).  Given  7  >  0  and  T  >  0 
and  w(t )  G  LV,  define 

8(x,w(t),~()  :=  sup{||/(x)  +  g{x)w{t)  -  f{y)  -  s(y)w(t)||  |Vx,  y  G  fi,  ||ar  -  y\\  <  7}  (15) 

for  almost  every  t  G  [0,T].  Then  map  t  6(x(t),w(t),  7)  is  measurable  on  [0,T],  Moreover,  let 
{7„}  be  a  positive  decreasing  sequence  converging  to  zero,  and  |r„}  be  a  positive  sequence  converging 
to  zero.  Then 

lim  —  /  S(x(s),w(s),jn)ds  =  0  (16) 

n->°°  TnJt 

almost  everywhere  in  [0,T]. 


Proof  It  is  obvious  that  the  map  t  8(x(t),w(t),  7)  is  measurable  on  [0,T].  It  is  noted  that  for 
almost  t  G  [0,T],  and  71  >  72  >  0  8(x(t),w(t),  71)  >  6(x(t),w(t),  72),  and 


lim  S(x(t ),  rc(t),  7)  =  0 


Now  Let  {7n}  is  a  decreasing  sequence  converging  to  zero.  We  will  show  (16)  holds  almost  every¬ 
where  in  [0,T].  In  fact,  by  Lebesgue’s  differentiation  theorem,  one  has 


1  ft+T 

liin  -  /  S(x(s),w(s),~/n)ds  =  8(x(t),w(t),in) 

t  ^  o  T  J  f 


(17) 


almost  everywhere  in  [0,  T]  for  each  n  G  Z+.  Therefore,  (17)  holds  almost  everywhere  in  [0,T]  for 
all  n  G  Z+,  since  Z+  is  countable. 

Now  take  t  G  [0,T]  such  that  (17)  holds  for  all  n  G  Z+.  Let  e  >  0  be  given.  Then  we  can  find 
niin2  £  Z+,  such  that  8(x(t),w(t), 7ni)  <  e/2,  and 


Tn 


8(x(s),w(s),jni)ds  <  6(x(t),w(t), 7„J  +  e/2 


for  n  >  n2.  Therefore,  if  n  >  max{n1,n2},  we  have 


Tn  Jt 


8(x(s),w(s),~in)ds  < 


l  ft  +  Tn 

Tn  Jt 


8(x(s),w(s),jni)ds  <  6(x(t),w(t),  7„J  +  e/2  <  e 


□ 
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Proof  [Theorem  2.9] 


It  is  noted  that  the  implication  (m)=^(ii)  is  obvious,  and  (n)=7(i)  follows  from  theorem  2.7.  We 
only  need  to  show  (i)=>(ra).  Suppose  K  C  is  a  compact  /^-performance  domain.  It  is  sufficient 
to  show  that  if  x0  E  K,  then  for  all  w  G  W,  <j>(t ,  x0,  w )  G  K  for  all  t  G  [0,  oo).  The  proof  is  divided 
into  two  steps. 

Claim  1:  Given  T  >  0,  for  the  given  w  G  W,  </>(/,  x,  w)  G  K  for  all  t  G  [0,  T]. 

Indeed,  take  r  >  0,  define  a  function  fr  :  K  x  [0,T]-dRn  as  follows, 

1  rt+T 

fT(x,t)  =  -  (/(*)  +  g(x)w(s))ds  =  f(x)  +  g(x)wT(i)  (18) 

T  Jt 

where 

1  ft+T 

wT(t )  :=  —  /  w(s)ds 

t  Jt 

which  is  continuous  on  [0,T].  In  fact,  for  all  ti,t2  G  [0,T], 

2  rt  2+T  /-<2 

||wr(t2)  -  ^r(/l)||  =  -  /  w(s)ds  —  /  w(s)ds 

since  ic(s)  G  BRP  for  almost  all  s  G  [0,  T}.  Therefore,  fT  is  continuous  on  the  compact  set  K  X  [0,  T], 
because  of  the  continuity  of  /  and  g,  we  can  assume  ||  f(x)  +  p(x)to||  <  (i  with  some  (3  >  0  for  all 
( x,w )  G  K  X  BRP.  Therefore,  by  (18),  it  follows  that  ||/T(x,f)||  <  f3.  Note  that 

1  fi+T 

|| wT(/)||  <  —  /  ||it>(s)||  ds  <  1 

T  Jt 

for  all  t  G  [O,!1].  Therefore,  wT  G  Wc  C  W.  Then  one  has 
fr(x,  t )  =  f(x)  +  g(x)wT(t )  G  Tk(x) 

for  all  x  G  K  t  G  R+.  By  Lemma  2.11,  the  solution  xT{t)  to  xT  =  fr(xT,t )  for  t  G  [0,T]  is  viable  in 
the  compact  set  K,  i.e.,  xT(t)  G  K  for  t  G  [0,T]. 

On  the  other  hand,  one  has  that  ||iT||  =  ||/T(x,t)||  <  fj.  Take  a  sequence  {«„(•)}  :=  (xTb(-)}, 
where  Tn—> 0  as  n-+  oo,  then  the  sequence  is  equicontinuous.  Then  by  Ascoli’s  Theorem,  the  sequence 
remains  in  a  compact  subset  of  the  Banach  space  C([ 0,  T],Kn);  therefore,  there  exists  a  subsequence, 
denoted  as  {x„}  without  loss  of  generality,  which  converges  uniformly  on  [0,T]  to  an  absolutely 
continuous  function  x  which  is  viable  in  K  since  K  is  closed.  Furthermore,  the  sequence  {xn} 
converges  to  x  because  xn  =  fT(xn(t),  t )  and  /  is  uniformly  continuous  on  the  compact  set  K  X  [0,  T). 
A  sequence  {7n}  is  chosen  as  follows, 

7 n  ||®n(<)  “  *(011  +  @Tn 

such  that  {q„}  is  decreasingly  converges  to  zero  (otherwise,  we  can  choose  a  decreasingly  subse¬ 
quence  instead),  and  for  all  s  G  [t,t  +  r„], 

Il*n(0  -  *(011  <  Il*n(0  -  *(/)ll  +  PTn  =  7 n 
Given  e  >  0,  by  Lemma  2.13,  there  exists  an  n0  G  Z+,  such  that  if  n  >  n0, 

*n (0  -  —  /  (/(*(«))  +  9(x(s))w(s))ds 

Tn  Jt 
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/t+Tn  rt  +  Tn 

(fixn(s))  +  g(xn(s))w(s))ds  -  I, 


(f(x(s))  +  g(x(s))w(s))ds 


^  rt  +  Tn 

<  — -  /  6(x(s),w(s),'jn)ds  <  e 

T„  Jt 

By  Lebesgue’s  differentiation  theorem,  one  has 

l  [t  +  Tn 

lim  —  /  (f(x(s))  +  g(x(s))w(s))ds  =  f(x(t))  +  g(x(t))w(t), 

n-'00  Tn  Jt 

since  f(x(s))  +  g(x(s))w(s)  is  bounded,  is  thus  integrable  on  [0,T].  Therefore, 
x(t)  =  f(x(t))  +  g(x(t))w(t),  x(0)  =  x0 , 

almost  everywhere  in  [0,T].  By  the  completeness  of  system  (13),  (f)(t,x0,w )  —  x(t)  €  K  for  all 
te[o,T}. 

Claim  2:  The  viable  solution  x(t )  in  K  can  be  extended  to  [0,oo). 

In  fact,  by  Zorn’s  Lemma,  one  can  extend  the  viable  solution  x(t )  in  K  to  the  interval  [0 ,Tmax) 
for  some  Tmax  >  T  [29],  i.e., 

x(t)eK,  V<  G  [Q,Tmax) 

and  Tmax  is  such  a  maximal  number.  Now,  we  show  Tmax  =  oo.  In  fact,  if  not  so,  define 


C  lim  sup  ||a:(t)||  <  oo 


as  K  is  closed  and  bounded.  Thence,  ||a:(t)||  <  C  + 1  for  t  G  [Tmax  —  r,  Tmax]  with  some  r  >  0.  Since 
||w(f)||  <  1,  then  ||x(i)||  =  ||/(*(f))  +  5(a:(f))u?(f)||  <  fi.  Therefore,  for  all  tut2  G  [Tmax  -  T,Tmax } 
with  ti  <  t2. 


x(tx)  -  x(t2) ||  <  [ 
JtX 


®(s)||  ds  <  j3(t2  -  h) 


Therefore,  the  Cauchy  criterion  implies  that  limt_T-^  x(t )  exists.  Let  x(Tmax)  :=  limt_T-^  x(t)  G 
K.  Since 

x(t)  =  x0+  x(s)ds, 

Jo 


let  ^Tmaxi  one  has 

rTmax 

—  %0  "1“  /  X^S^ds 
JO 

Then  the  solution  can  be  extended  to  [0,  Tmax\.  Now  x(Tmax )  G  K,  the  same  argument  as  in  Step 
1  shows  that  there  exists  T0  >  0  such  that  x{t)  can  be  extend  to  [0 ,Tmax  +  T0).  This  leads  to  a 
contradiction  about  the  maximality  of  Tmax.  Therefore,  Tmax  —  oo.  □ 
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3  /^-Control  of  Nonlinear  Systems 

In  this  section,  we  will  consider  the  nonlinear  /^-control  synthesis  problem  based  on  the  char¬ 
acterizations  of  /^-performance  in  the  previous  section.  A  static  state-feedback  T1- controller  is 
constructed  for  a  nonlinear  system. 

Consider  the  following  input-affine  system. 

(  x  =  f(x)  +  gi(x)w  +  g2(x)u  (  . 

(  z  =  h(x)  +  ki(x)w  +  k2(x)u 

where  x  G  R”  is  the  state  vector,  w  G  BRP  :=  { v  G  Rp|  ||u||  <  1},  u  G  Rm,  and  2  G  R5  are 
the  external  disturbance  input,  the  control  input,  and  the  regulated  output,  respectively.  We  will 
assume  /,  fiq,  </2, /i,  &i,  and  k2  are  continuous  on  R",  RANK(</i(a:))  =  n  and  RANK(g2(x))  =  rn  for 
all  x  G  Rn,  and  /( 0)  =  0  and  h( 0)  =  0.  Therefore,  0  G  Rn  is  an  equilibrium  of  the  system  with 
w  =  0  and  u  =  0.  Moreover,  we  assume  the  admissible  disturbance  set  for  system  (19)  is 

W  :=  {»  G  £oo[0,  oo)|  <  1}  =  R£oo[0,  oo )  (20) 

The  /T-control  problem  for  system  (19)  is  defined  as  follows, 

Definition  3.1  The  state-feedback  /^-control  synthesis  problem  is  to  find  a  continuous  state- 
feedback  u  =  ip(x)  for  system  (19)  such  that  the  resulting  closed-loop  system  has  the  T1  -performance. 

Define  a  set- valued  map  U  :  R”  Rm  as  follows, 

U(x)  :=  {u  G  Rm|  \\z\\  =  || h{x)  +  kfix)w  +  k2(x)u\\  <  1  ,Vu>  G  BRP}  (21) 

with  domain 

Dom(CI)  :=  {xGRn|C/(a;)^0}. 

Therefore,  if  u  =  ipfx)  is  an  admissible  C1  -controller,  then  it  necessarily  satisfies  fi(x)  G  U(x)  for 
all  x  G  Dom(17).  We  thus  define  the  set  of  admissible  (state-feedback)  controllers  for  the  system 
G  as  follows, 

K,  {ip  :  Rn-*Rm|  is  continuous  on  Dom(L)  and 

ip(x)  G  U(x)  for  all  x  G  Dom(?7)  with  ip(0)  =  0}  (22) 

Let  F  :  Graph(CI)  ~~>  R"  be  another  set-valued  map  defined  as  follows, 

F(x,  u )  :=  {f(x)  +  gi(x)w  +  g2(x)u\w  G  BRP}  (23) 

One  immediately  has  the  following  observations.  The  upper  semi-continuous  (USC),  lower 
semi- continuous  (LSC),  and  Marchaud  maps  are  defined  in  Appendix  A. 

Lemma  3.2  (i)  The  set-valued  map  U  :  Mn  Rm  defined  in  (21)  is  locally  bounded,  USC,  as  well 
as  LSC  with  closed  values;  and  Dou(U)  is  closed. 

(ii)  The  set-valued  map  F  :  Graph(?7)  Rn  defined  in  (23)  is  USC;  if  in  addition  DoM(f7) 
is  bounded,  then  it  is  Marchaud. 
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Define  Fc 
Fc(x) 


En  R"  by 

U  F(x,u), 
ueu(x) 


(24) 


then  the  differential  inclusion  x  G  Fc(x ),  which  is  derived  from  system  (19),  is  a  controlled  differ¬ 
ential  inclusion  (F,  U )  defined  by  (21)  and  (23).  We  first  have  the  following  definition. 

Definition  3.3  Consider  system  (19)  and  its  corresponding  controlled  differential  inclusion  (F,  U) 
defined  by  (21 )  and  (23).  Suppose  K  C  Dom(U)  is  closed,  then  K  is  a  controlled  /^-performance 
domain  if  0  G  K  and  for  each  x  G  K  there  exists  u  G  U(x)  such  that 


F(x,u)  C  Tk(x ) 


(25) 


It  will  be  shown  in  the  next  section  that  a  controlled  /^-performance  domain  for  system  (19) 
is  a  closed  controlled  invariance  domain  of  (F,  U ).  Next,  we  will  characterize  the  solvability  of  C1- 
control  synthesis  problem  in  terms  of  the  controlled  /^-performance  domains.  It  is  assumed  that 
system  (19)  is  complete  in  the  sense  that  for  each  w(t )  G  W,  u(t)  G  £co[0)  °°)  or  u  =  ijj(x)  G  /C, 
and  x0  G  R”,  the  solution  x(t)  to  (19)  starting  at  *(0)  =  x0  is  uniquely  defined  for  almost  every 
t  G  [0,oo),  and  the  solutions  are  continuously  dependent  on  the  initial  states.  We  first  have  the 
following  assertion. 

Theorem  3.4  (Necessary  Conditions)  Consider  system  (19).  If  the  C1  -control  problem  has  a 
static  state-feedback  solution,  then  there  exists  a  controlled  Ll  -performance  domain. 

Proof  If  the  £x -control  problem  has  a  state-feedback  solution,  then  there  exists  a  state  feedback 
xjj  G  1C  such  that  the  following  closed-loop  system 


x  =  f(x)  +  g2(x)Tp(x)  +  gi(x)w 
z  =  h(x)  +  k2(x)fi(x )  +  ki(x)w 


(26) 


has  the  Cl -performance.  Define  a  set 

fic  :=  {%  G  Mn|  ||^(*)  +  k2(x)'4}{x)  +  ki(x)w\\  <  1  ,Vw  G  BRP}. 

Let  Dinv(Dc)  be  the  largest  /^-performance  domain  of  the  closed-loop  system  (26)  contained  in 
0.  By  Theorem  2.8,  0  G  Dinv(Dc)  ^  0;  and  moreover,  Dinv(Dc)  is  a  controlled  /^-performance 
domain  for  the  original  system  by  Definition  3.3.  □ 

It  is  noted  that,  the  above  theorem  holds  for  more  general  class  of  nonlinear  systems  in  addition 
to  the  class  of  input-affine  systems.  Next,  we  will  give  a  sufficient  condition  for  a  modified  /L-control 
problem  to  have  a  solution.  Consider  system  (19).  For  e  G  [0, 1),  define  the  following  performance. 


J€  =  sup  ||z| 

weCoofO.ocO.IHI^l  — e 


(27) 


We  will  construct  a  state-feedback  «(•)  G  K,  such  that  the  closed-loop  system  satisfies  J€  <  1  for 
any  e  G  (0, 1).  We  have  the  following  theorem.  The  sleek  sets  are  defined  in  Section  7.2. 

Theorem  3.5  (Sufficient  Conditions)  If  there  exists  a  sleek  compact  controlled  C1  -performance 
domain  for  system  (19),  then  for  all  e  G  (0, 1),  there  exists  a  continuous  static  state  feedback  such 
that  the  closed-loop  system  satisfies  Je  <  1. 
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Proof  Suppose  K  ^  0  is  a  sleek  compact  controlled  C1  -performance  domain  for  system  (19).  It 
is  sufficient  to  construct  a  state-feedback  C1  -controller  u  =  cp  G  K,  such  that  the  following  modified 
system 

f  x  =  f(x)  +  (1  -  e)g1(x)w  +  g2(x)u  ^8) 

y  z  =  h(x)  +  (1  —  e)ki(x)w  +  k2(x)u 

with  the  constructed  controller  achieves  /P-performance. 

As  K  G  Dom(?7)  is  sleek,  Tk  •  K  -w  Rn  is  LSC  with  closed  convex  values.  Define  a  set  valued 
map  T£  :  K  ^  Rn  as 

T\x)  :=  +  (1  -  e)gi(x)w  G  TK(x),Vw  G  BRP}.  (29) 

It  is  easy  to  see  that  set- valued  map  Tf  is  LSC  with  closed  convex  values  on  K .  Define  the  (allowable 
control)  set-valued  map  Ce  :  K  K"  as 

Ce( x)  :=  {u  G  U (x)\f(x)  +  g2(x)u  G  Te(x)} 

It  can  also  be  seen  that  the  set- valued  map  C£  has  closed  convex  values  on  K. 

On  the  other  hand,  we  claim  that  there  exists  an  a  >  0  such  that  for  all  x  G  K,  there  exists  a 
u  G  Ce(x)  such  that 

/( x)  +g2(x)u  +  r  G  Te(x) 

for  all  rGK"  such  that  ||r||  <  a.  In  fact,  since  T°(x )  C  Te(x )  for  0  <  e,  we  have  C°(x )  C  Ce(x). 
Also  K  ^  0  implies  C°(x)  0  for  all  x  G  K.  Therefore,  there  exists  u  G  C°(x)  C  Ce(x),  such  that 

f{x)+  g2(x)u  G  T°(x ) 


or 


f(x)  +  g-i{x)u  +  egx{x)w  G  Te(x),  Vw  G  BRP 

Then  the  claim  is  justified  since  gi(x)  has  rank  n  on  the  compact  set  K. 

By  employing  Theorem  7.3,  we  can  immediately  deduce  that  the  set- valued  map  Ce  is  LSC. 
Furthermore,  it  can  be  verified  that  0  G  C£(0).  We  now  use  Michael’s  selection  theorem  (Propo¬ 
sition  7.4)  to  conclude  that  there  exists  a  continuous  selection  ip  :  K->-Km  of  set-valued  map 
C€  :  K  M"  with  ip( 0)  =  0,  then  ip  G  /C. 

Now  we  claim  that  the  state  feedback  u  =  ip(x)  is  the  desired  controller.  Indeed,  the  closed-loop 
system  is 

f  x  =  f(x)  + g2(x)ip(x)  +  (1  -  e)g1(x)w  .  . 

^  z  =  h(x)  +  k2(x)ip(x)  +  (l  —  e)k1(x)w  ^ 

From  the  construction,  we  know  that  for  all  x  G  K  and  w  G  BRP, 

f(x)  +  g2(x)ip(x)  +  (1  -  e)gi{x)w  G  TK(x). 

Thus  the  sleek  set  K  ^  0  is  an  /^-performance  domain  for  the  above  closed-loop  system  (30).  Thus, 
Theorem  2.9  shows  that  the  closed-loop  system  (30)  has  C1  -performance.  Therefore,  the  resulting 
controller  for  system  (19)  yields  J£  <  1.  □ 
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4  £' -Control  and  (Controlled)  Invariance 

In  this  section,  we  will  characterize  the  (controlled)  C1  -performance  domains  in  terms  of  corre¬ 
sponding  (controlled)  differential  inclusions.  The  notions  of  (controlled)  invariance  play  a  central 
role. 

4.1  Differential  Inclusions  and  Invariance  Domains 

Given  a  set-valued  map  F  :  X  X ,  we  mainly  consider,  in  this  subsection,  the  following  differential 
inclusion 

x(t )  E  F(x(t)),  for  almost  all  t  G  [0,oo)  (31) 

A  function  x  :  R+-*X  is  said  to  be  viable  in  a  subset  K  C  X  if  x(t )  E  K  for  all  t  E  M+  [1]. 
We  have  the  following  definition. 

Definition  4.1  Consider  differential  inclusion  (31).  The  subset  K  C  X  is  said  to  be  invariant 
under  F  if  for  all  x0  E  K ,  any  solution  to  (31)  starting  at  x0  is  viable  in  K .  Given  any  closed  subset 
ft  C  Dou(F).  The  largest  closed  subset  of  Cl  which  is  invariant  under  F,  denoted  by  iNV^(ft)1, 
is  called  the  invariance  kernel  (IK)  of  ft.  The  smallest  closed  subset  of  X  invariant  under  F 
containing  ft  is  called  invariant  envelope  (IE)  of  ft,  denoted  as  Env^(O)1. 

We  first  have  the  following  lemma. 

Lemma  4.2  The  class  of  invariance  subsets  under  F  is  closed  under  the  operation  of  subset  union. 

The  above  lemma  implies  that  the  invariance  kernel,  if  exists,  is  unique;  The  invariant  envelope, 
which  always  exists  by  Zorn’s  lemma,  is  also  unique.  It  is  known  that  if  F  is  Lipschitz,  then 
there  exists  an  invariance  kernel  for  closed  subset  ft  C  Dom(T)  [1,  Theorem  5.4.2].  The  following 
theorem  gives  another  class  of  such  nonlinear  systems  of  interest  in  this  paper. 

Theorem  4.3  Suppose  the  set-valued  map  F  :  Dom(F)  -w  X  is  Marchaud.  Then,  for  any  closed 
subset  ft  C  Dom(F),  there  exists  an  IK  (possibly  empty )  of  Cl.  It  is  the  subset  of  initial  points  such 
that  all  solutions  starting  from  them,  are  viable  in  ft. 

The  proof  of  this  theorem  is  given  in  Appendix  B.  Definition  4.1  can  hardly  be  conveniently  im¬ 
plemented  for  checking  the  invariance  sets  and  computing  the  invariance  kernels.  We  next  give  an 
alternative  notion. 

Definition  4.4  Let  F  :  X  X  be  given.  K  C  Dom(jF)  is  an  invariance  domain  (ID)  of  F  if 
for  all  x  E  K ,  F(x)  C  TK(x).  Given  any  closed  subset  ft  C  Dom(-F).  We  denote  by  DlNVjp(ft)  the 
largest  closed  invariance  domain  under  F  in  ft,  and  by  DENVj?(ft)  the  smallest  dosed  invariance 
domain  of  F  containing  ft . 

Recall  the  definition  of  the  C1  -performance  domains  in  Section  2,  it  is  known  from  the  above 
definition  that  any  C1  -performance  domain  is  an  invariance  domain  of  the  corresponding  differential 
inclusion  (10)  and  (11).  Therefore,  DlNVj’(ft)  exists  for  a  class  of  parameterized  set-valued  maps 
F  :  E"  -w  R™.  From  Theorem  2.9,  we  immediately  have  the  following  theorem  which  characterizes 
the  C1  -performance  of  system  (2)  in  terms  of  the  invariance  domains. 

1If  clear  from  context,  the  subscription  F  will  be  dropped. 
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Theorem  4.5  Consider  system  (2)  and  its  corresponding  differential  inclusion  (10)  and  (11);  sup¬ 
pose  the  system  is  affine  in  w;  the  compact  set  ft  is  defined  in  (9).  Then  the  following  statements 
are  equivalent. 

(i)  The  system  has  weak  C 1  -performance. 

(ii)  0  G  DlNVF(ft). 

(in)  Denv_f({0})  C  ft. 

Furthermore,  if  any  of  the  above  statements  holds,  then  for  any  C1  -performance  domain  K , 
which  is  well-defined,  one  has 

0  G  Denv f({0})  C  K  C  DmvF(ft)  c  f l. 

Therefore,  if  the  system  has  the  C1  -performance,  then  Denvf({0})  and  DlNVF(ft)  are  the 
smallest  and  the  largest  ^-performance  domains,  respectively.  In  the  following,  we  will  give  some 
algorithms  for  computing  the  (closed)  invariance  domains  in  a  given  closed  subset  ft  C  Dom(T’). 
By  modifying  viability  kernel  algorithms  in  [1,  pp. 147-153],  one  has  the  following  algorithms. 

Algorithm  4.6  Let  F  :  X  X  and  a  closed  subset  ft  C  DoM(i?)  be  given.  Define  recursively  the 
subsets  I\'n  by 

F  o  :=  ft, 

K„+ i  :=  {x  €  Kn\F(x)  c  TKJx)} 
where  if  Kn  is  empty  in  some  step  n  stop  there;  otherwise  define 

OO 

ft'oo  :=  fl  K«  (32) 

n~  0 

It  is  observed  that  if  Kn  =  0  for  some  n  G  Z+,  then  DlNVF(ft)  =  0;  otherwise,  DlNVF(ft)  C  Koo 
if  exists,  since  DlNVf(ft)  C  Kn  for  all  n.  However,  in  general,  the  inclusion  can  not  be  replaced  by 
equality,  i.e.,  the  above  algorithm  does  not  yield  the  maximal  invariance  domain  contained  in  ft. 
Because  the  algorithm  does  not  guarantee  the  subsets  Kn  to  be  closed;  also  in  general  the  upper 
limit  of  the  contingent  cones  TKn(x)  is  not  necessarily  contained  in  the  contingent  cone  to  the  upper 
limit,  of  the  subsets  Kn  [1].  In  the  following,  an  alternative  algorithm  yielding  a  closed  invariance 
domain  which  is  a  subset  of  DlNVF(ft)  is  provided.  This  algorithm  is  a  modification  of  viability 
domain  algorithm  [1,  p.151];  the  set-valued  map  Tk  :  X  X  defined  in  Definition  7.8  is  used. 

Algorithm  4.7  Let  F  :  X  ^  X  and  a  compact  subset  ft  C  Dom(T)  be  given.  Given  a  constant 
c  >  0,  define  recursively  the  subsets  Kf  by 

Kq  :=  ft- 

K+i  :=  {xeK\F(x)cTkcn(x)}. 

If  Kcn  is  empty  in  some  step  n,  then  stop  there;  otherwise  define 

OO 

Kk  :=  H  K  (33) 

n  —  0 

Theorem  4.8  Let  F  :  X  X  be  LSC  and  ft  C  Dom(T)  be  a  compact  subset.  In  the  above 
algorithm,  if  Kf  f  0  for  all  n  G  Z+,  then  Kf,  a  nonempty  closed  invariance  domain  of  F. 

The  proof  is  given  in  Appendix  B. 
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4.2  Controlled  Differential  Inclusions  and  Controlled  Invariance 

Let  X,  Y,  and  Z  be  metric  spaces.  Given  two  set-valued  maps,  U  :  X  Z  and  F  :  Graph(I7)  Y , 

Define  a  parameterized  set- valued  map  Fe  :  X  Y  as  follows, 

Fe(x):=  (J  F(x,u) 

uGU(x) 

with  Dom(Fc)  =  Dom(I7).  Then  the  differential  inclusion  x  £  Fc(x)  is  called  a  controlled 
differential  inclusion  (CDI),  denoted  as  ( F.U ). 

Definition  4.9  Consider  a  CDI  defined  by  (F.U).  A  subset  K  £  Dom(I7)  is  controlled  in¬ 
variant  under  (F,  U)  if  there  exists  a  measurable  function  u  :  R+— >Rm  such  that  for  all  x0  £  K , 
the  differential  inclusion  x  £  F(x,u(t ))  has  all  solutions  starting  at  x0  and  viable  in  K,  and 
u(t )  £  U(x(t ))  for  all  t.  £  R+.  Given  any  closed  subset  12  C  Dom(27),  The  largest  closed  subset 
of  Q,  which  is  controlled  invariant  under  ( F,U ),  denoted  by  ClNv(fl),  is  called  the  controlled  in¬ 
variance  kernel  (CIK)  of  D,  and  the  controlled  invariance  envelope  (CIE)  Cenv(O)  of  fl  is 
defined  as  the  smallest  closed  controlled  invariant  subset  containing  f2  under  ( F ,  U ). 

The  notion  of  controlled  invariance  (or  (A,  i?)-invariance  for  linear  systems)  was  defined  for 
linear  systems  to  deal  with  disturbance  decoupling  in  [28],  and  for  nonlinear  systems  in  the  context 
of  zero  dynamics  [18,  2].  The  controlled  invariance  envelope  exists  and  is  unique.  The  controlled 
invariance  kernel,  if  exists,  is  also  unique,  because  of  the  following  observation. 

Lemma  4.10  The  class  of  controlled  invariance  subsets  under  ( F,  U)  is  closed  under  the  operation 
of  subset  union. 

The  following  theorem  characterizes  the  existence  of  CIK  in  a  given  closed  set. 

Theorem  4.11  Consider  the  CDI  defined  by  ( F,U ).  Suppose  0  C  Dom(27)  C  X  is  compact,  the 
set-valued  maps  U  :  Dom(U)  Z  is  LSC  with  closed  convex  values,  and  F  :  Graph(K)  -w  X  is 
Marchaud.  Then  there  exists  a  CIK  (possibly  empty)  of  12. 

Proof  Since  U  :  Dom(U)  Z  is  LSC,  by  Michael’s  selection  theorem  (Proposition  7.4)  there 
exists  a  continuous  selection  u(x)  £  U(x ).  Define  a  new  set-valued  map  Fu  :  fi  X  as  Fu(x)  := 
F(x,u(x )).  Since  F  :  Graph(I/)  X  is  Marchaud,  then  there  exists  C  >  0  such  that 

||T’u(®)||  =  ||P(a:,w(x))||  <  C(||a;||  +  ||«(a:)||  +  1)  <  C(CU  +  1)(|M|  +  1) 

with  Cu  >  0  being  such  that  ||«(a;)||  <  Cu  as  u  is  continuous  on  the  compact  set  fi,  so  Fu  is  also 
Marchaud.  Therefore,  by  Theorem  4.3,  there  exists  a  maximal  invariance  kernel  InvFu(0),  and  it 
is  controlled  invariant  under  (F,  U )  by  the  definition.  Zorn’s  Lemma  implies  that  there  exists  a 
maximal  controlled  invariance  subset,  which  is  the  CIK,  of  D.  □ 

From  the  above  theorem  and  Lemma  3.2,  the  controlled  differential  inclusion  ( F ,  U )  defined  by 
(21)  and  (23)  has  the  CIK  in  Dom(C)  if  Dom({7)  is  compact. 

Definition  4.12  Consider  the  CDI  defined  by  ( F,U ).  A  subset  K  £  Dom(£7)  is  a  controlled 
invariance  domain  (CID)  of  (F,U)  if  for  all  x  £  K,  there  exists  a  u(x )  £  U(x)  such  that 
F(x,u(x))  C  Tk(x).  Given  any  closed  subset  12  C  Dom(27);  Dci(f2)  is  the  largest  closed  controlled 
invariance  domain  in  f2  under  ( F,U ),  and  Dce(I2)  is  the  smallest  closed  controlled  invariance 
domain  containing  0  for  (F,  U). 
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Recall  the  definition  of  the  controlled  /^-performance  domains  in  the  last  section,  it  is  known 
from  the  above  definition  that  any  controlled  /^-performance  domain  of  system  (19)  is  a  controlled 
invariance  domain  of  the  controlled  differential  inclusion  (F,  U )  defined  by  (21)  and  (23).  Therefore, 
Dci(Q)  exists  for  a  class  of  parameterized  controlled  differential  inclusions.  We  immediately  have 
the  following  theorem  which  characterizes  the  controlled  Cl -performance  of  system  (19)  in  terms 
of  the  controlled  invariance  domains. 

Theorem  4.13  Consider  system  (19)  and  its  corresponding  controlled  differential  inclusion  (F,  U ) 
defined  by  (21)  and  (23).  Suppose  Dou(U )  is  compact,  and  K  G  Dom(CI)  is  a  controlled  Cl- 
performance  domain.  Then  0  G  Dce({0})  C  K  C  Dinvf(Dom(17))  C  Dom({7). 

Therefore,  if  the  system  has  controlled  C1  -performance,  then  Dce({0})  and  Dci(DoM(i[7))  are 
the  smallest  and  the  largest  controlled  £1-performance  domains,  respectively.  In  the  following, 
we  give  some  algorithms  to  compute  the  controlled  invariance  domains  in  some  given  closed  set. 
Those  algorithms  are  modifications  of  the  (A,  J3)-invariance  algorithm  for  linear  systems  [28],  the 
controlled  invariance  kernel  algorithm  for  controlled  difference  inclusions  [23],  and  the  zero 
dynamics  algorithm  [18,  21]. 

Algorithm  4.14  Let  F  :  X  X  and  a  closed  subset  SI  C  Dom(F)  be  given.  Define  recursively 
the  subsets  Kn  by 

Rq  :=  f l, 

Kn+ 1  :=  {x  G  Kn\F(x,u)  G  TKn(x),  for  some  u  G  U(x).} 

Define 

00 

Woo  :=  n  K"  (34) 

n=0 

It  is  observed  that  Dci(fl)  C  Kn  for  all  n,  then  Dci(fl)  C  /fM .  However,  in  general,  the 
inclusion  can  not  be  replaced  by  equality.  In  the  following,  we  give  a  remedy  to  this  problem  as 
in  Algorithm  4.7,  however,  instead  of  Dci(O)  itself,  only  a  closed  invariance  domain,  which  is  a 
subset  of  Dci(fi),  is  obtained. 

Algorithm  4.15  Let  F  :  X  x  Z  X  and  a  compact  subset  SI  C  Dom(W)  be  given.  Given  a 
constant  c  >  0,  define  recursively  the  subsets  Krn  by 

Kq  :=  -Q, 

:=  {x  G  Kl\F(x,u)  G  c(x),  for  some  u  G  U(x)}. 

Then  either  W®  is  empty  in  some  step  n,  or 

OO 

KU  :=  fl  Kn  (35) 

n— 0 

is  not  empty. 

Theorem  4.16  Suppose  Lt  is  compact  and  F  :  X  X  Z  X  is  LSC,  U  :  Z  X  is  locally  bounded 
USC  with  closed  values.  In  the  above  algorithm,  either  Kcn  is  empty  in  some  step  n,  or  K;0  is  a 
nonempty  closed  controlled  invariance  domain  of  F. 

The  proof  is  given  in  the  Appendix  B. 
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5  Approximation  Methods  for  /^-Performance  Analysis  and  Syn¬ 
thesis 

The  C1  -performance  analysis  and  synthesis  for  nonlinear  systems  are  reduced  to  the  computations 
of  (controlled)  invariance  domains  for  some  (controlled)  differential  inclusions.  However,  unlike  the 
discrete  time  systems,  the  algorithms  given  in  the  last  section  are  not  easy  to  implemented.  In 
this  section,  we  will  try  to  give  some  alternatives  characterization  for  the  (controlled)  invariance 
domains  and  approximate  them  in  terms  of  the  (controlled)  invariance  domains  of  the  corresponding 
Euler  approximated  discrete-time  systems.  To  this  end,  we  give  the  following  definition  [4,  p.17]. 

Definition  5.1  Let  {Kn}\n&z+  be  a  sequence  of  subsets  of  a  metric  space  X.  The  upper  limit  of 
the  sequence  is  a  closed  subset  of  X  defined  as 

lim  sup  Kn  :=  {x  £  X\ liminf  d(x,  Kn)  —  0} 

n  — oo  00 

Therefore,  lim  supn_^co  Kn  is  the  set  of  cluster  points  of  sequence  xn  £  Kn,  i.e.,  of  limits  of 
subsequence  xni  £  Knr 

5.1  ^-Performance  of  Discrete-Time  Nonlinear  Systems 

The  material  in  this  subsection  is  just  the  reformulation  of  some  results  from  [23]. 

^-performances 

Consider  the  following  discrete-time  nonlinear  system 

f  x(k  +  1)  =  fd{x(k),  w(k ))  ,  , 

\  z(k)  =  hd(x(k),w(k))  [  ’ 

where  fd  and  hd  are  continuous.  The  ^^performance  for  system  (36)  is  defined  similarly  to  that  in 
the  continuous  times  case  (see  Definition  2.1).  Let  a  set-valued  map  Fd  :Rn  Rn  be  defined  as 

Fd(x)  :=  {fd(x,w)\w  £  BRP) 

with  the  domain  DoM(Td)  =  fl,  where 

n  :=  {x  £  R"|  \\hd{x,w)\\  <  l,Vw  £  BRP} 

is  assumed  bounded.  We  can  also  similarly  define  the  invariance  and  the  invariance  kernel  of  a 
closed  set  for  the  corresponding  difference  inclusion.  We  have  the  following  result  [23,  Proposition 

4.1], 

Proposition  5.2  The  invariant  kernel  lNVf(i(fi)  in  fi  for  difference  inclusion  x(k  +  1)  £  Fd(x(k )) 
exists,  and 

OO 

In vFd(fi)  =  P|  Ks 

3  =  1 

where  K0  —  0,  Kj+ 1  =  {x  £  Kj  :  Fd(x)  C  Kj } •  Moreover,  system  (36)  has  i1 -performance 
J  :=  sup  II^H^  <  1 

if  and  only  if  0  £  lNVFd(Q)  ^  0. 
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CONTROLLED  INVARIANCE  AND  ^-CONTROL 


Let  X  and  Y  be  metric  spaces.  Given  two  set-valued  map  Ud  :  X  Y ,  Fa  :  GRAPH (/7rf)  X, 

then  the  difference  inclusion 

x(k  +  1)  E  U  Fd(x(k),u) 

ue.Ud(x(k) 

defines  a  controlled  difference  inclusion,  denoted  as  (Fd,  Ud ),  we  can  similarly  define  such  concepts  as 
controlled  invariance  and  controlled  invariance  kernel  of  a  closed  set  under  (Fd,  Ud)  [23,  Definitions 
4.3  and  4.4].  The  following  result  is  due  to  Shamma  [23,  Proposition  4.2]. 

Proposition  5.3  Consider  a  controlled  difference  inclusion  defined  by  ( Fd,Ud )■  Suppose  91  C 
Dou(Ud)  is  compact,  Ud  '■  X  Y  is  locally  bounded  USC  with  closed-values,  and  Fd  :  GRAPH(f7d) 

X  is  LSC.  Then  the  controlled  invariance  kernel  ClNv(fi)  of  91  for  (Fd,  Ud)  exists  (possibly  empty). 
And 

CO 

Cinv(O)  =  pi  Kj 

3=0 

where  Kj  is  recursively  defined:  K0  :=  91  and  Kj+1  =  {x  E  Kj\Fd(x,  u)  C  Kj  for  some  u  E  Ud(x)}. 
Next,  consider  the  following  discrete-time  control  system 

T  x(k  +  1)  =  fd(x(k))  +  gdi(x(k))w(k)  +  gdl(x(k))u(k)  7) 

(  z(k)  =  hd(x(k ))  +  kdl(x(k)w(k)  +  kd2(x(k))u(k) 

with  fd,9di,9d2,hd,kdi,  and  kd2  being  continuous,  and  Rank^^z))  =  n  for  all  x  E  Mn.  Similarly, 
the  ^-control  problem  for  system  (37)  can  be  defined  as  did  for  the  continuous  time  case  (see 
Definition  3.1).  Define  Ud  :  Rn  Rm 

Ud(x)  :=  {u  G  Rm|  || hd(x)  +  kdl(x)w  +  kd2{x)u\\  <  l,Vw  G  BRP} 

Suppose  91  :=  DOM(f7d)  is  bounded.  Note  that  Ud  is  locally  bounded  USC  with  closed  values.  Let 
a  set-valued  map  Fd  :  M"  X  be  defined  as 

Fd(x,  u)  :=  {fd(x)  +  gd i(x)w  +  gd2(x)u)\w  G  BRP} 

with  domain  Dou(Fd)  =  91.  We  have  the  following  results  about  f^-control  problem  slightly 
generalizing  Shamma’s  theorems  [23,  Theorem  5.1]  and  [22,  Theorem  3.1]. 

Proposition  5.4  Consider  system  (37).  Then  the  following  statements  are  true. 

(i)  ClNV(fi)  exists. 

(ii)  If  the  system  has  F-control  solution  such  that  J  <  l,  then  0  G  ClNv(fi)  ^  0. 

(Hi)  If  0  G  Cinv(O)  ^  0  and  ClNv(fi)  is  convex,  then  for  all  e  E  (0, 1),  there  exists  a  continuous 
static  state  feedback  such  that  the  closed-loop  system  satisfies: 

Jc  :=  sup  H^ll^  <  1.  (38) 

t«e^oo,||»||00<l-e 
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It  is  remarked  that  the  results  about  ^-performance  analysis  and  synthesis  can  also  be  charac¬ 
terized  in  terms  of  (controlled)  invariance  envelope.  For  example,  we  have  the  following  version  of 
Proposition  5.4. 

Proposition  5.5  Consider  system  (37).  Then  the  following  statements  are  true. 

(i)  If  the  system  has  F-control  solution,  then  Cenv({0})  C  il. 

(Hi)  //Cenv({0})  C  12  and  Cenv({0})  is  convex,  then  for  alle  €  (0, 1),  there  exists  a  continuous 
static  state  feedback  such  that  the  closed-loop  system  satisfies  (38). 


is  assumed  bounded.  Note  that  the  map  FT  is  LSC  because  of  the  continuity  assumption  on  /  for 
system  (13).  Consider  the  difference  inclusion  xT(k  +  1)  G  FT(xT(k)).  Then  by  Proposition  5.2,  we 
know  that  invariant  kernel  lNV^r(I2)  in  f2  for  difference  inclusion  xT{k  +  1)  G  FT(xT(k ))  exists;  and 
the  discrete-time  system  (39)  has  I1  -performance  if  and  only  if  lNVFr(f2)  ^  0. 

We  have  the  following  result  about  the  approximations  of  the  C1  -performance  domains  for 
system  (13). 


Theorem  5.6  Consider  system  (13).  Let  {r„}  be  a  decreasing  sequence  such  that  r„— > 0  as  n— > oo, 
and  VTn  C  0  be  closed  and  invariant  under  FTn  for  each  rn  with  0  G  VTn .  Then  :=  lim  supn_0Q  VTn 
is  a  C1  -performance  domain  for  system  (13). 


It  is  noted  that  in  Theorem  5.6,  for  each  r„,  the  corresponding  Euler  approximated  discrete-time 
system  has  ^-perfonnajice  ./  <  1.  Possible  choices  for  VTn  are  lNV2Prji(f2)  and  ENVfrn({0}). 
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Proof  Choose  w  G  Wc  and  x0  G  Poo,  then  the  solution  <f>(t,x0,w)  to  the  differential  equation 
x  =  f(x,w(t ))  with  x(0)  =  x0  is  bounded.  We  first  show  that,  for  all  T  >  0,  <f>(t,x0,w)  G  Pc  for 
all  t  G  [0,  T). 

Consider  the  function  fw(x,t)  :=  f(x,w(t)),  which  is  continuous  on  compact  set  Q  x  [0,T]; 
therefore,  \\f(x,w(t))\\  <  (3  for  some  /?  >  0,  and  it  is  uniformly  continuous  on  fl  X  [0,jT].  Given 
e  >  0,  there  thus  exists  6  >  0  such  that  for  all  r  G  (0,£], 

\\f(xi,w(ti))  -  /(®2,  w(h))\\  <  e  (41) 

for  all  ( Xi,t{ )  G  fi  x  [0,T]  (i  =  1,2)  with  ||xi  -  x2||  <  <5  and  - 12\  <  £■ 

Since  x0  G  P*,,  there  exists  x°n  G  VTn  such  that  x0  is  a  cluster  point  of  the  sequence  {x°};  we 
assume  x°  — >x0  as  n—+  oo  without  loss  of  generality.  On  the  other  hand,  rn— >0  as  n— »oo,  there  exists 
N  >  0  such  that  rn  G  [0,min{£,  6/f3})  for  all  n  >  N.  Take  n  >  N,  we  consider  a  solution  xTn{k) 
for  the  difference  equation  defined  in  (39): 


Xrn{k  +  1)  —  /rn  (*r„  (^))  WTn(k')) 

with  xTn(0)  =  x°.  Then  xTn{k)  G  PTl>  for  all  k  G  Z+  by  the  definition  of  VTn.  Now  we  associate  with 
the  solution  a  function  xn  G  C([0,T),Kn)  as 

xn(f)  :=  xTn{k)  +  +  ^ — Xr^k\t  -  krn) 

T~n 

for  all  k  >  0  and  t  G  [krn,(k  +  l)r„)  such  that  t  G  [0,T).  Note  that  xTn(k  +  1)  -  xTn(k)  = 
rnf(xTn(k)fwTn(k);  thus, 

\XTn(k  +  1)  -  XTn{k)  I 


|*n(<)  ®rB(^')||  ^ 


r„  <  f3rn  <  6 


and  xn(t)  =  f(xTn(k),  wTn(k))  for  t  G  [krn,  {k  +  l)r„)  (hence  ||x„(f)||  <  /?).  From  (41),  we  thus  have 
\\xn(t)  -  f(xn(t),w(t))\\  <  e  (42) 


for  all  t  G  [0,T).  On  the  other  hand,  xn(t)  is  bounded,  then  xn(t)  is  equicontinuous.  Similar 
argument  in  terms  of  Ascoli’s  Theorem  in  the  proof  of  Theorem  2.9  (i)  yields  that  a  subsequence  of 
{xn(t)},  still  denoted  as  {xn(t)}  without  loss  of  generality,  converges  to  an  absolutely  continuous 
function  x(t),  and  their  derivatives  x„(f)— >x(f)  as  n— >oc.  (42)  implies  that 

x(t)  =  f(x(t),w(t )) 


Since  xn(0)  =  xTn(0)— >x0  as  n—>o o;  and  each  t  >  0  is  the  limit  of  nodes  ktrn ,  so  x(t)  is  the  limit 
of  xTn(kt)  G  KTn-  Then  x(t)  G  Pc  for  all  t  G  [0,T).  By  the  completeness  of  the  given  system, 
<f(t,x0,w)  =  x(t)  G  Wo  for  all  t  G  [0,T). 

Finally,  from  similar  argument  in  Theorem  2.7,  one  can  conclude  that  for  all  x  G  Poo,  f(x,  w)  G 
TVoo(x)  for  all  w  G  BRP.  Therefore,  p*,  is  an  C1  -performance  domain  for  system  (13).  □ 

The  following  theorem,  which  generalizes  [6,  Theorem  2],  characterizes  the  T,1 -performance 
domains  for  a  class  of  special  systems  which  include  the  linear  systems. 


Theorem  5.7  Consider  system  (13).  Suppose  there  exists  r  >  0  such  that  VT  C  is  closed, 
convex,  and  invariant  under  FT  with  0  G  VT.  Then  VT  is  an  C1  -performance  domain  for  system 
(13). 
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Proof  Since  VT  C  LI  is  invariant  under  FT,  one  has  that  for  all  x  G  VT,  FT(x )  6  VT,  or  given 
w  G  BRP, 

x  +  r/(x,  w)  G  VT 

By  the  assumption  VT  is  convex,  then 
x  +  hf(x,  w)  G  VT 

for  all  h  G  [0,r].  Now  by  Lemma  7.5,  it  follows  that 
f(x,w)  G  TVr(x) 

for  all  w  G  BRP.  Therefore,  VT  is  an  ^^performance  domain  for  system  (13).  □ 


5.3  Approximation  of  Controlled  ^-Performance  Domains 

Consider  system  (19),  which  is  rewritten  as  follows, 

f  x  =  f(x)  +  gi(x)w  +  g2{x)u 
\  z  =  h(x)  +  ki(x)w  +  k2(x)u 

where  w  G  Wc.  Given  r  >  0,  define  a  corresponding  difference  equation,  which  is  a  Euler  approxi¬ 
mation  of  system  (19),  as  follows, 

f  xT(k  T  1)  —  fT {xT (fc),  wr(k) ,  tiT(fc))  (43) 

(  zT(k)  —  h(xT(k))  +  ki(xT(k)wT(k)  +  k2(xT(k))uT(k) 

where  wT(k )  :=  w(r k),  and 

fT(x,  w,  u )  :=  x  +  r{f(x)  +  g^x)w  +  g2{x)u).  (44) 

Define  U  :  En  Rm  as 

U(x)  :=  {u  €  Mra|  \\h{x)  +  fei(*)iu  +  fc2(*)ti||  <  l,Viu  G  BRP} 

Let  Ll  Dom(U)  be  bounded.  Since  U  is  locally  bounded  USC  with  closed  values  by  Lemma  3.2. 
Then  there  exists  a  compact  set  U  C  Rm,  such  that 

U  U(x)  C  U 

xEfl 

Let  a  set-valued  map  FT  :  Rn  X  Rm  Rn  be  defined  as 
Ft(x,  u )  :=  { fr(x ,  w ,  u)|w  G  BRP} 

with  the  domain  DoM(f'V)  =  Ll.  Consider  the  controlled  difference  inclusion  defined  by  (FT,  U ).  By 
Proposition  5.3,  the  controlled  invariance  kernel  CiNv(fl)  of  ( FT,U )  exists  in  Ll]  and  under  some 
mild  conditions,  the  discrete-time  system  (43)  has  -C-control  solution  if  and  only  ClNV(fi)  ^  0  (see 
Theorem  5.4). 

We  have  the  following  result  on  the  approximations  of  controlled  C1  -performance  domains. 

Theorem  5.8  Consider  system  (19).  Let  {r„}  be  a  decreasing  sequence  such  that  rn^0  as  ft— » oo, 
VTn  C  LI  be  controlled  invariant  under  ( FTn ,  IJ)  for  each  r„  with  0  G  VTn .  Then  VT  :=  lim  supn_co  VTn 
is  a  controlled  C1  -performance  domain  for  system  (19). 

It  is  noted  that,  in  Theorem  5.8,  for  each  r„,  the  corresponding  Euler  approximated  discrete- time 
system  has  a  nonempty  controlled  ^-performance  domain.  Possible  choices  for  VTn  are  ClNV(Lt) 
and  Cenv({0}). 
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Proof  One  needs  to  show  that  there  exists  u  G  U(x)  such  that  f(x,  w,  u )  G  TVao(x)  for  all  x  G  Ko 
and  re  G  BR". 

Suppose  w  E  Wc  and  x0  G  Pco-  We  first  show  that,  given  T  >  0,  there  exists  a  measurable 
function  u(t)  such  that  the  solution  £(t)  to  the  differential  equation  x  —  f(x,w(t),u(t))  with 
*(0)  =  x0  is  in  Voo  for  all  t  G  [0 ,  T)  and  u(t )  G  U(£(t)). 

Consider  the  function  fw(x,t,u )  :=  f(x,  w(t),  u),  which  is  continuous  on  compact  set  fix[0,T]x 
U ;  therefore,  \\f(x,w(t),u)\\  <  (3  for  some  j3  >  0,  and  it  is  uniformly  continuous  on  0  x  [0,T].  Now 
given  e  >  0,  there  exists  S  >  0  such  that  for  all  r  G  (0,<5], 

\\f(xu  w(ti),  u)  -  f(x2,w(t2),  it)||  <  e  (45) 

for  all  (xi,ti,u)  Gfix[0,T]xW  with  \\xx  -  x2\\  <  S  and  | tx  —  t2\  <  S. 

Since  x0  G  Voo,  therefore  there  exists  x°n  G  VTn  such  that  x0  is  a  cluster  point  of  the  sequence 
we  assume  x°n— >x0  as  n—> oo  without  loss  of  generality.  On  the  other  hand,  rn^0  as  n—r oo, 
there  exists  N  >  0  such  that  r„  G  [0,min{(5,  6/ ft})  for  all  n  >  N.  We  consider  a  solution  xTn(k )  for 
the  difference  equation  defined  in  (39)  for  some  n>  N, 


%rn(k  +  1)  —  fTn(xTn(k),  wTn(k),  uTn{k )) 


with  xTn(0)  =  x°.  Then  by  the  definition  of  VTn,  there  exists  uTn(k )  G  U(xTn(k ))  such  that 
xTn(k )  G  VTn  for  all  k  G  Z+.  We  define  a  function  xn  G  C([0,T),Rn)  as 


xn(t^  .  —  x Tn ( k, )  T 


xTn(k  +  1)  xTn(k)  ^  _  j^t  . 

Tn 


for  all  k  >  0  and  t  G  [krn,(k  +  l)rn)  such  that  t  G  [0,T).  Note  that  xTn(k  +  1)  -  xTn{k)  = 
Tnf(xTn(k),u>Tn(k),uTn(k ));  thus, 


||xn(<)  xTn(k) ||  < 


xrn(k  +  l)  -  XTn(k) 

Tn 


Tn  <  f3Tn  <6 


and  xn(t )  =  f(xTn(k),wTn(k),uTn(k))  for  t  G  [krn,(k  +  l)r„).  Let  the  function  un  :  [0,T)^Rm  be 
defined  as 


Unit )  :=  uTn(k), 

for  t  G  [krn,(k  +  l)rn)  C  [0,T).  Therefore,  from  (45),  we  have 

\\xn(t)  -  f(x„(t),  w(t),  u„(i))||  <  e  (46) 

for  all  t  G  [0,  T). 

It  is  noted  that,  xn(t )  is  bounded,  hence  xn{t)  is  equicontinuous.  Then  the  similar  argument  in 
terms  of  Ascoli’s  Theorem  in  the  proof  of  Theorem  2.9  (i)  yields  that  a  subsequence  of  {a;n(f)},  still 
denoted  as  {xn(t)}  without  loss  of  generality,  converges  to  an  absolute  continuous  function  x(t), 
and  their  derivatives  xn(t)—>x(t)  as  n-^ oo. 

On  the  other  hand,  given  t  G  [0,T),  then  x{t)  is  a  limit  point  of  some  xTn(k)',  since  for  t  G 
[krn,(k  +  l)rn),  un(t )  =  uTn{k)  G  U(xTn(k ))  G  U ,  there  exists  a  subsequence  of  {«„(/))},  still 
denoted  it  as  {un(t)},  converges  to  some  u(t )  G  U(x(t ))  since  U  is  USC  with  closed  values.  Note 
that  u  :  [0,T)— 4Rm  can  be  chosen  to  be  measurable  by  the  construction2. 

2For  example,  u(t)  =  (limsup^^  •  •  •  dimsup^^^  where  un  :=  (w*,  •  •  • ,  «™)T;  u{t)  is  measurable 

since  its  components  are  upper  limits  of  simple  functions. 
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Therefore,  (46)  implies  that 
*(<)  =  f{x(t),w(t),u(t)) 

Since  a:„(0)  =  £t„(0)— >x0  as  n—> oo;  for  each  t  >  0  is  the  limit  of  nodes  ktTn,  x(t )  is  the  limit  of 
xTn(kt)  G  KTn.  Then  x(t)  G  F*,  for  all  t  G  [0,T).  The  completeness  of  the  given  system  implies 
f(t)  =  x(t )  G  Too  for  all  t  G  [0,T). 

Finally,  we  will  show  that  is  a  controlled  £1-performance  domain  for  system  (19).  Take 
x0  G  Voo.  For  given  w  G  7/c,  there  exists  a  essentially  bounded  function  u  :  R+-^Rm,  such  that 
the  unique  solution  x(t)  for  x  =  f(x)  +  gi(x)w(t)  +  g2(x)u(t)  with  z(0)  =  x0  is  viable  in  F^  and 
u(t)  G  U(x(t)).  One  only  needs  to  check  that  i(0)  =  f{x 0)  +  gi(xo)w(0)  +  g2(xo)u(0)  G  TVix(x0). 
In  fact,  for  all  t  E  [0,  T],  x(t)  G  Foo 

x(t)  =  x0+  f  x(s)ds  =  x0  +  t(  j  /  (f(x(s))  +  g1(x(s))w(s)  +  g2(x(s))u(s))ds) 

Jo  t  Jo 

Notice  that  / (x(s))+ g1(x(s))w(s) + g2(x(s))u(s)  is  essentially  bounded  in  [0,  T],  then  by  Lebesgue’s 
differentiation  theorem,  one  has 
1  /•* 

lim  -  (f(x(s))  +  ffi(a:(s))«j(s)  +  g2(x(s))u(s))ds  =  f(x0)  +  gi(x0)w(Q)  +  g2(xo)u(0) 

Therefore,  one  can  find  two  sequences  { tn }  and  {un}  with  tn— >0+  and  vn^>-f(x0)  +  gi(xo)w(0)  + 
g2(x0)u(0)  as  n— > oo,  such  that  x0  +  tnvn  G  Fx.  for  all  n  G  Z+.  Hence,  f(x0)  +  gi(xo)w(0)  + 
g2(x0)u(Q)  G  Tvx{x 0),  the  conclusion  then  follows  by  Lemma  7.5.  □ 

The  following  theorem  characterizes  the  controlled  T1 -performance  domains  for  a  class  of  special 
systems  which  include  the  linear  systems. 

Theorem  5.9  Consider  system  (19).  Suppose  there  exists  r  >  0  such  that  VT  C  0  is  closed,  convex, 
and  controlled  invariant  under  ( FT ,  U )  with  0  G  VT.  Then  VT  is  a  controlled  C1  -performance  domain 
for  system  (19). 

Proof  The  argument  is  similar  to  that  in  the  proof  of  Theorem  5.7.  □ 


6  Conclusions 

In  this  paper,  the  /T-control  problems  for  nonlinear  systems  were  investigated.  The  £1-performance 
analysis  and  the  /^-control  synthesis  problems  were  characterized  in  terms  of  the  £1-performance 
domains  and  the  controlled  £1-performance  domains,  which  are  the  invariance  domains  and  the  con¬ 
trolled  invariance  domains  of  the  corresponding  differential  inclusions,  respectively.  This  treatment 
therefore  provided  some  geometrical  insights  into  the  robust  (C1)  control  problem.  In  addition, 
the  relation  between  the  /T-control  of  a  continuous-time  system  and  the  ^-ccmtrol  of  its  Euler 
approximated  discrete-time  systems  was  established.  Nonetheless,  the  computational  implications 
of  the  results  for  general  nonlinear  systems  in  this  paper  are  not  clear.  The  results  in  this  paper 
can  serve  for  didactic  purpose,  and  can  be  used  to  guide  the  design  of  nonlinear  control  systems 
with  disturbance  attenuation  properties. 

Another  issue  that  was  not  explicitly  addressed  in  this  paper  is  the  asymptotic  property  of  the 
nonlinear  T1 -control  systems,  i.e.,  when  the  initial  states  are  not  in  any  of  the  £} -performance 
domains,  in  which  case  the  systems  do  not  have  TEpCTfommjme  initially,  do  the  systems  eventually 
have  Cl -performance  as  they  evolve?  This  issue  can  be  investigated  in  the  framework  reported  in 
[20]. 
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7  Appendix  A:  Set- Valued  Maps 

In  this  section,  we  will  review  some  basic  notions  from  set-valued  analysis.  We  refer  to  the  books 
[3,  4,  1]  for  detailed  account  about  the  related  issues. 

7.1  Set- Valued  Maps  and  Their  Selections 

Let  X  and  Y  be  two  normed  spaces.  A  set  valued  map  F  from  X  to  Y  is  a  map  that  associates 
with  any  x  £  X  a  subset  F(x)  of  Y.  We  denote  it  as 

F  :X  y. 

The  subset  F(x)  is  called  the  value  of  F  at  x  £  X .  The  domain  and  graph  of  F  are  defined  as 
Dom(T)  :=  {xeX  :  F(x)  ±  0}. 

Graph(F)  :=  {(®,y)  £X  xY\y  £  F{x)} 

Definition  7.1  Consider  a  set-valued  map  F  :  X  Y . 

(i)  It  is  said  to  be  lower  semi-continuous  (LSC)  if  for  all  xo  £  X,  y0  £  F(x 0),  and  any 
sequence  of  elements  xn  £  Dom(T)  converging  to  xq,  there  exists  a  sequence  of  elements  yn  £  F(xn) 
converging  to  t/o- 

(ii)  It  is  said  to  be  upper  semi-continuous  (USC)  if  for  all  x0  £  X ,  y  £  F(x 0),  and  for 
any  open  subset  N  of  Y  containing  F(x 0),  there  exists  a  neighborhood  N(so)  of  xQ  such  that 
F( N(*0))  C  N. 

Note  that  if  F  is  USC  with  closed  domain  and  closed  values,  then  Graph(F)  is  closed.  Two  special 
classes  of  continuous  set-valued  maps  are  defined  as  follows, 

Definition  7.2  Consider  a  set-valued  map  F  :  X  Y . 

(i)  It  is  said  to  be  Marchaud,  if  it  is  USC,  has  compact  convex  images,  and  has  linear  growth 
property,  i.e.,  there  exists  C  >  0  such  that  for  all  x  £  Dom(F), 

||J,(*)||  <  C(\\x\\  +  1)  (47) 

where  ||F(ar)||  :=  supy€F(x)  ||y||. 

(ii)  It  is  said  to  be  Lipschitz  around  x  £  X  if  there  exist  a  positive  constant  L  and  a  neighbor¬ 
hood  W  C  Dom(F)  of  x  such  that  for  all  xx,x2  £  VV 

F(x i)  C  F(x2)  +  L  ||*i  -  x2\\  By 

Note  that,  if  F  :  X  Y  is  bounded  on  Dom(T),  then  it  has  the  linear  growth  property  (47). 
The  following  technical  result  will  be  used  [3,  p .49] . 
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Proposition  7.3  Let  X  be  a  metric  space  and  Y  and  Z  be  Banach  spaces.  Let  f  :  X  X  Z— >Y  be  a 
continuous  map  such  that  for  all  x  £  X,  u  >—►  f(x,  u)  is  affine.  Let  set-valued  maps  T  :  X  •w  Y  and 
U  :  X  Z  be  LSC,  and  let  U  be  locally  bounded.  Suppose  there  exists  an  a  >  0  such  that  for  all 
x  £  X,  there  exists  a  u  £  U(x )  such  that  f(x,u )  +  r  £  T(x)  for  all  r  £  Y  with  ||r||  <  a.  Then  the 
set-valued  map  C  :  X  U  defined  by 

C(x)  :=  {u  £  U(x)\f(x,u)  £  T(x)}  (48) 

is  LSC. 

Given  a  set-valued  map  F  :  X  Y,  there  is  map  /  :  X—dY  which  is  a  selection  of  F,  i.e. 
f(x)  £  F(x)  for  each  x  £  X.  For  a  class  of  set-valued  maps,  we  have  the  following  lemma  which  is 
known  as  Michael’s  selection  theorem  (cf  [4,  p.355]). 

Proposition  7.4  Let  X  be  a  metric  space,  Y  a  Banach  space,  F  :  X  Y  which  has  the  closed 
convex  subsets  as  its  values  be  LSC.  Then  there  exists  a  continuous  selection  f  :  X  — ► Y  from  F.  In 
addition,  if  y0  £  F(x0),  then  the  continuous  selection  f  of  F  can  be  chosen  such  that  f(x0)  =  y0. 


7.2  Contingent  Cones 

Let  X  be  a  finite  dimensional  normed  space,  I(  be  a  nonempty  subset  of  X ,  for  each  x  £  X,  define 
the  distance  of  x  to  K  as 


di((x)  :=  d(x,I( )  :=  inf  ||a:  -  y 

y£K 


(49) 


Define  a  set- valued  map  TK  :  X  X, 


Tk{x)  {u|  lim inf 


dK(x  +  hv)  -  dK(x) 

T 


<0} 


(50) 


For  all  a:  £  X ,  the  value  TK{x )  is  a  closed  cone,  and  is  called  the  contingent  cone  to  K 
at  x.  Note  that  if  K  denotes  the  closure  of  K ,  then  %  =  Tk\  if  a;  £  Ii ,  then  Tk(x )  = 
{n|  liminfft_»o  +  dK(x  +  hv)/r  =  0},  and  if  £  6  Int (K)  0,  then  Tk(x)  =  X.  Also  if  K  is  a 
manifold  in  X ,  then  for  any  x  £  K,  Tk(x )  defines  the  tangent  space  of  K  at  x.  The  following 
following  lemma  characterizes  contingent  cones  in  terms  of  sequences  [4,  p.  122] . 


Lemma  7.5  Given  a  set  K  C  X  and  x  £  K .  v  £  TK(x )  if  and  only  if  there  exist  a  nonincreasing 
sequence  hn-> 0  and  a  sequence  vn^v,  such  that  x  +  hnvn  £  K  for  all  n. 


A  subset  K  of  X  is  said  to  be  sleek  if  the  set-valued  map  TK  :  K  ^  X  is  LSC.  The  following 
result  is  from  [1,  p.  161] . 

Proposition  7.6  If  K  is  sleek,  then  for  all  x  £  K, 

Tk(x)  =  {v  |  lim  dK(y  +  hv)/h  =  0} 

h-*0+,y-*Kx 

and  Tjfc(x)  is  a  closed  convex  cone  for  all  x  £  K . 

Convex  sets  are  sleek.  We  next  state  a  result  about  the  computing  the  contingent  cone  of  a  set 
which  is  defined  by  some  inequalities  [4,  p.123]. 
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Proposition  7.7  Given  a  C1  vector-valued  function  g  =  (<7i,</2,  •  •  ',gP)  -X— rRF.  Define  a  set 
K  :=  {a-  £  X\ gfix)  >  0 ,*  =  1,2 ,  •  ■  * , p} 

Given  x  £  K,  define  I(x)  :=  {i  =  1,2,  •  ■  •,p|gri(x)  =  0},  then  under  the  regularity  condition  that 
there  exists  v0  £  X  such  that  for  all  i  £  I{x),  <  g'i(x),v0  >>  0.  Then  one  has  that  for  all  x  E  K 
such  that  if  I(x)  —  0,  TK(x)  =  X,  otherwise 

Tk(x)  =  {v  E  X\  <  g'i(x),v>>  0,Vi  E  I(x)} 

Some  alternatives  to  TK  :  X  X  have  some  nice  properties,  one  is  the  Clarke  cone  which  has 
convex  closed  values  [9].  In  the  following,  we  give  another  set-valued  map  Tfi  :  X  X,  whose 
values  belong  to  the  values  of  Tk  [1,  p.148]. 

Definition  7.8  Let  K  C  X  be  closed,  c  >  0,  and  x  E  K .  The  global  contingent  set,  denoted  by 
Tk(x),  is  the  subset  of  all  v  £  Tk(x )  such  that  there  exists  a  measurable  function  'y(-)  bounded  by 
c  and  satisfying 

x  +  tv  +  /  (t  —  T)~/(r)dT  E  K 
Jo 

It  is  noted  that  if  cx  >  c2  >  0,  then  T'fi  D  T£ .  And  if  v  E  TK(x),  then  there  exists  c  >  0  such  that 
v  E  Tfi(x).  One  of  the  nice  properties  about  the  global  contingent  set  is  that  its  graph  is  closed 
(see  Lemma  8.2). 

8  Appendix  B:  Proofs 

PROOF  OF  THEOREM  4.3 


Given  F  :  X  X ,  consider  the  following  differential  inclusion 


x(t)  £  F(x(t)),  for  almost  all  t  £  [0,oo) 

(51) 

Define  a  set-valued  map 

SF  :  Dom(F)  C([0,oc);X) 

(52) 

such  that  Sf{x)  is  the  set  of  all  solutions  to  the  differential  inclusion  (51)  starting  at  a(0)  =  x  £ 
Dou(F).  Sf  is  called  the  solution  map  of  differential  inclusion  (31)  (see  [1]).  We  have  the 
following  result  about  the  solution  map  which  follows  from  [1,  Theorem  3.5.2], 

Lemma  8.1  Suppose  F  :  X  X  is  Marchaud,  then  the  set  valued  map  Sp  defined  in  (52)  is  USC 
with  compact  values  supplied  with  the  compact  convergence  topology.  Moreover,  the  graph  of  the 
restriction  £f|k  of  Sp  to  any  compact  subset  K  of  Dom(F)  is  compact  in  X  X  C([0,  oo);X). 

The  proof  of  Theorem  4.3  follows  the  similar  ideas  in  the  proof  of  existence  of  viability  kernel 
[1,  Theorem  4.1.2]. 
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Proof  [Theorem  4.3]  Let  V(ft)  C  C([0,  oo);X)  denote  the  subset  of  functions  viable  in  ft  C 
Dom(-F).  Define 

Inv i?(ft)  :=  {z  £  tl\SF(x)  C  V(ft)} 


We  first  show  the  set  lNV>(ft)  is  closed.  In  fact,  given  x  £  lNVF(ft),  and  let  {a;n}  C  lNVF(ft)  be 
a  sequence  such  that  xn-*x  as  n— »•  oo.  Therefore,  there  exists  a  compact  set  K  C  X  such  that  x  and 
xn  £  K.  Take  a  sequence  {£n}  C  SF(xn),  then  the  sequence  {(*„,£„)}  belongs  to  Graph(5f)|x, 
which  is  compact  by  Lemma  8.1.  Therefore,  there  exists  a  subsequence  of  {(a;n,£n)}  converging  to 
some  (x,£)  £  Graph(5f)|x.  Therefore,  £  £  SF(x)  c  V(ft).  Hence,  x  £  lNVF(ft). 

Next,  we  show  lNV>(ft)  is  invariant  under  F.  Indeed,  take  x  £  lNV>(ft),  we  need  to  show  that 
any  £  £  SF(x)  is  viable  in  lNVF(ft),  i.e.,  £(T)  £  lNVF(ft)  for  all  T  >  0.  In  fact,  let  £T  £  SF(£(T)), 
define  a  function  £0  as  follows, 


Zo(t)  ■= 


m  if*e[0,T] 
£T(t  -  T)  if  t>T 


Then  £0  is  a  solution  to  the  differential  inclusion  starting  at  x  at  time  0,  and  thus,  is  viable  in  ft 
by  the  definition  of  lNVF(ft).  Hence  for  all  t  >  T,  £T(f  —  T)  £  ft,  therefore  5f(£(T)  c  V(ft),  i.e., 
Z(T)  £  iNVf(ft). 

Finally,  we  show  lNV>(ft)  is  the  largest  invariance  set  contained  in  ft.  Indeed,  let  K  C  ft  is  a 
closed  invariance  set  of  F,  then  for  all  x  £  K,  there  exists  a  solution  £  to  the  differential  inclusion 
starting  at  x  which  is  viable  in  It',  thus  in  ft.  Therefore,  x  £  lNVF(ft).  □ 


PROOFS  OF  THEOREMS  4.8  AND  4.16 

The  set-valued  map,  T \  :  X  X ,  is  defined  in  Definition  7.8.  The  proofs  of  the  two  theorems 
make  use  of  the  following  properties  of  Tk  [1,  Proposition  4.4.2].  The  upper  limit  of  a  set  sequence 
is  defined  in  Definition  5.1. 

Lemma  8.2  The  graph  of  the  set-valued  map  Tf  :  K  X  is  closed.  In  addition,  let  Kx  := 
limsupn_+O0  K„  denote  the  upper  limit  of  a  sequence  of  closed  subsets  Kn .  Then 

lim  sup  Graph (T^J  c  Graph (TFoJ 

n—+oo 

Proof  [Theorem  4.8]  We  first  show  that  Kcn  defined  in  the  Algorithm  4.7  is  closed  for  each 
n  £  Z+.  In  fact,  K0  is  closed  by  definition.  Suppose  Kcn  is  closed,  it  is  sufficient  to  show  K„+1  is 
closed.  To  this  end,  take  a  sequence  iXi}  G  &n+li  such  that  Xi^x  £  K°  as  n—+  oo.  Note  that 

F(xi)  C  Tkc(x{)  (53) 

We  need  to  show  F(x)  C  T^c(x). 

In  fact,  take  any  y  £  F(x),  since  F  is  LSC,  then  there  exists  a  sequence  y,  £  F(x{),  such  that 
Vi~+y  as  i—>  oo.  Note  that  from  (53), 

(Xi,Vi)  £  Graph(T^c) 

And  Graph(T^o)  is  closed  by  Lemma  8.2,  therefore 
lim (xi,yi)  =  (x,y)  £  Graph(T^) 
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Therefore  y  £  TrK,:(x)  as  required.  Therefore  x,-*x  £  K°+1. 

To  show  is  invariant  under  F,  take  x  £  K^0 ,  we  need  to  verify  F(x)  C  Tj(c  ( x ). 

Note  that  x  £  K*  for  n  £  Z+,  then  we  have  _F(a;)  C  T^-C(x).  Now  for  all  y  £  F(x),  then 
?/  £  TjCc(x).  Therefore,  (x,y)  C  Graph(T£c),  or 

CO 

(x,y)  C  P|  Graph(T^c)  C  Graph (T^) 

n=l 

where  the  last  inclusion  is  from  Lemma  8.2.  Thus,  y  £  Tbc  (a:).  □ 

Next,  we  prove  Theorem  4.16. 

Proof  [Theorem  4.16]  We  first  show  that  K‘  defined  in  the  Algorithm  4.15  is  closed  for  each 
n  £  Z+.  In  fact,  K0  is  closed  by  definition.  Suppose  K°  is  closed,  it  is  sufficient  to  show  K°+1  is 
closed.  To  this  end,  take  a  sequence  { }  C  K‘+1,  such  that  Xi~-*x  £  as  n— > oo.  Note  that  there 
exists  Ui  £  U(xi)  such  that 

F(xi,Ui)  C  T^c(xi)  (54) 

for  each  i  £  Z+.  Note  that  U  is  locally  bounded  and  USC  with  closed  value.  Then  there  exists  a 
subsequence,  still  denoted  as  {n,}  without  loss  of  generality,  converging  to  some  u  £  U(x).  Now 
we  show  that  F(x,u)  C  Tjj- c(x). 

In  fact,  take  any  y  £  F(x,u ),  since  F  is  LSC,  then  there  exists  a  sequence  y{  £  F(xi,U{ ),  such 
that  'iji — > y  as  i—* oo.  Note  that  from  (54), 

(*.-,&•)  £  Gbaph(T^) 

Since  Graph )  is  closed  by  Lemma  8.2,  therefore 

Jim (xi,yi)  =  (x,y)  £  Graph(T^c) 

Therefore  y  £  T^{x)  as  required.  Therefore  x^x  £  Krn+l. 

We  next  show  is  controlled  invariant  under  (F,  U ).  To  this  end,  take  x  £  K^,  then  x  £ 
for  n  £  Z+,  therefore  there  exists  un  £  U(x)  for  each  n  £  Z+,  F(x,  un)  C  TUx).  Since  U  is  locally 
bounded  and  USC  with  closed  value,  there  exists  a  subsequence,  {uHt}  C  {wn},  converging  to  some 
u  £  U(x).  We  now  show  F(x,u )  C  Thjx). 

In  fact,  for  all  y  £  F(x,u ),  there  exists  a  sequence  {?/„,},  such  that  y„t  £  F(x,uni)  C  (x), 
and  yn,-^y  £  F(x,u )  as  i— >oo.  On  the  other  hand, 

(*,i0  =  lim(*,yn.)  £  Graph(T^.  ) 

2 — ►  OO  n  j 

Then  y  £  T£c  («).  Note  that 

OO  OO 

ku  =  n  ^  =  n  k, 

n— 1  2—1 

Then, 

OO 

(®,y)  C  P  Graphic.)  C  Graph(T^) 

2  —  1 

where  the  last  inclusion  is  from  Lemma  8.2.  Therefore,  y  £  ITC  (x).  □ 

-“■oo  ^  ^ 
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